vm-test-run-nixbot-gitlab
checks.aarch64-linux.nixbot-gitlab
· build #312
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.hMF94NBOA2', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13(finished: start all VMs, in 73.07 seconds)14gitlab # Discarding device blocks: 0/262144 done15gitlab: waiting for unit setup-gitlab.service16gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes17gitlab: waiting for the VM to finish booting18gitlab # Filesystem UUID: bd10af91-54df-4be3-b3fc-9020b5e74b1e19gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/2lq549hlmr3awhzdqzdkn3yyjrvd3hqq-nixos-system-gitlab-test/init regInfo=/nix/store/d5y2jffahwvkh1q6biqpidggy73mjxrh-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/d5y2jffahwvkh1q6biqpidggy73mjxrh-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f00000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f10000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000031] arm-pv: using stolen time PV108gitlab # [ 0.000390] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000553] Console: colour dummy device 80x25110gitlab # [ 0.000560] printk: legacy console [tty0] enabled111gitlab # [ 0.000736] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000742] pid_max: default: 32768 minimum: 301113gitlab # [ 0.000830] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.000953] landlock: Up and running.115gitlab # [ 0.000956] Yama: becoming mindful.116gitlab # [ 0.001383] LSM support for eBPF active117gitlab # [ 0.001584] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.001691] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.002920] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.003616] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.003620] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.003780] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.004857] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.004951] EFI services will not be available.125gitlab # [ 0.005110] smp: Bringing up secondary CPUs ...126gitlab # [ 0.005764] Detected PIPT I-cache on CPU1127gitlab # [ 0.005863] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.005996] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000129gitlab # [ 0.006127] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.007271] Detected PIPT I-cache on CPU2131gitlab # [ 0.007379] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.007511] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000133gitlab # [ 0.007652] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.008727] Detected PIPT I-cache on CPU3135gitlab # [ 0.008844] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.008975] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000137gitlab # [ 0.009103] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.009600] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.009627] SMP: Total of 4 processors activated.140gitlab # [ 0.009630] CPU: All CPU(s) started at EL1141gitlab # [ 0.009638] CPU features: detected: Branch Target Identification142gitlab # [ 0.009642] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.009645] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.009648] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.009652] CPU features: detected: Common not Private translations146gitlab # [ 0.009655] CPU features: detected: CRC32 instructions147gitlab # [ 0.009657] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.009660] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.009663] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.009666] CPU features: detected: E0PD151gitlab # [ 0.009668] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.009671] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.009674] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.009677] CPU features: detected: Fine Grained Traps155gitlab # [ 0.009679] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.009683] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.009685] CPU features: detected: LSE atomic instructions158gitlab # [ 0.009688] CPU features: detected: Privileged Access Never159gitlab # [ 0.009690] CPU features: detected: PMUv3160gitlab # [ 0.009693] CPU features: detected: RAS Extension Support161gitlab # [ 0.009695] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.009697] CPU features: detected: Random Number Generator163gitlab # [ 0.009700] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.009702] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.009705] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.009708] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.009835] alternatives: applying system-wide alternatives168gitlab # [ 0.012784] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.013005] Memory: 5963840K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.014461] devtmpfs: initialized171gitlab # [ 0.018533] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.018604] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.018806] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.018810] 0 pages in range for non-PLT usage175gitlab # [ 0.018812] 508288 pages in range for PLT usage176gitlab # [ 0.018930] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.019759] DMI not present or invalid.178gitlab # [ 0.023011] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.025660] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.025937] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.027784] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.027806] audit: initializing netlink subsys (disabled)183gitlab # [ 0.028132] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.028580] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.028583] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.028588] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.028590] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.028593] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.028682] cpuidle: using governor ladder190gitlab # [ 0.028748] cpuidle: using governor menu191gitlab # [ 0.028958] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.029136] ASID allocator initialised with 65536 entries193gitlab # [ 0.030230] Serial: AMBA PL011 UART driver194gitlab # [ 0.035407] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.035751] printk: console [ttyAMA0] enabled196gitlab # [ 0.047502] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.047537] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.047547] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.047556] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.047564] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.047572] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.047580] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.047588] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.059173] fbcon: Taking over console205gitlab # [ 0.059184] ACPI: Interpreter disabled.206gitlab # [ 0.060212] iommu: Default domain type: Translated207gitlab # [ 0.060228] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.069892] SCSI subsystem initialized209gitlab # [ 0.070344] usbcore: registered new interface driver usbfs210gitlab # [ 0.070368] usbcore: registered new interface driver hub211gitlab # [ 0.070386] usbcore: registered new device driver usb212gitlab # [ 0.070642] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.070646] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.070654] PTP clock support registered215gitlab # [ 0.070692] EDAC MC: Ver: 3.0.0216gitlab # [ 0.071218] scmi_core: SCMI protocol bus registered217gitlab # [ 0.072161] FPGA manager framework218gitlab # [ 0.072939] vgaarb: loaded219gitlab # [ 0.074966] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.075452] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.075476] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.077516] netfs: FS-Cache loaded223gitlab # [ 0.077630] pnp: PnP ACPI: disabled224gitlab # [ 0.085938] NET: Registered PF_INET protocol family225gitlab # [ 0.086882] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.115800] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.115850] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.115894] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.116218] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.116771] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.116868] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.116920] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.117031] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.117185] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.117212] NET: Registered PF_XDP protocol family236gitlab # [ 0.117228] PCI: CLS 0 bytes, default 64237gitlab # [ 0.117550] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.127856] kvm [1]: HYP mode not available239gitlab # [ 0.213910] Initialise system trusted keyrings240gitlab # [ 0.214297] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.215359] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.215435] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.232231] Key type asymmetric registered244gitlab # [ 0.232237] Asymmetric key parser 'x509' registered245gitlab # [ 0.232362] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.232720] io scheduler mq-deadline registered247gitlab # [ 0.232737] io scheduler kyber registered248gitlab # [ 0.247272] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.251507] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.252512] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.252549] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.252574] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.252590] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.252656] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.252708] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.252990] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.253009] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.253020] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.253029] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.253039] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.253298] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.254799] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.255449] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.255485] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.255597] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.255635] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.257131] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.257729] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.257764] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.257844] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.259491] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.260117] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.260153] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.260233] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.261781] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.262352] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.262387] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.262465] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.264029] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.264603] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.264638] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.264717] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.266218] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.266789] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.266824] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.266903] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.268436] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.269011] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.269046] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.269141] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.269177] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.270777] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.271435] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.271516] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.273056] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.273721] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.273801] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.275164] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.275808] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.276651] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.277369] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.277406] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.277484] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.279092] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.279738] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.279774] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.279853] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.281706] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.281724] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.281735] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.281882] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.282026] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.282159] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.282309] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.282447] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.282581] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.282727] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.282859] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.283031] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.283204] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.283337] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.283390] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.283447] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.283503] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.283569] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.283624] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.283679] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.283735] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.283792] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.283861] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.283929] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.283984] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.284037] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.284100] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.284153] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.284218] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.284283] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.284347] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.284401] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.284454] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.284508] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.284575] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.284590] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.284599] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.288723] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.319180] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.323505] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.327807] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.334132] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.338173] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.342230] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.348675] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.352917] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.357226] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.362918] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.367562] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.377469] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.380501] msm_serial: driver initialized359gitlab # [ 0.380792] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.380887] STM32 USART driver initialized361gitlab # [ 0.408221] loop: module loaded362gitlab # [ 0.408546] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.411483] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.414447] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.417180] virtio_blk virtio5: [vdb] 12284560 512-byte logical blocks (6.29 GB/5.86 GiB)366gitlab # [ 0.420659] megasas: 07.734.00.00-rc1367gitlab # [ 0.421708] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.424550] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.424575] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.426894] Using buffer write method371gitlab # [ 0.426940] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.429709] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.429728] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.432488] Using buffer write method375gitlab # [ 0.432508] Concatenating MTD devices:376gitlab # [ 0.432512] (0): "0.flash"377gitlab # [ 0.432515] (1): "0.flash"378gitlab # [ 0.432518] into device "0.flash"379gitlab # [ 0.577240] Freeing initrd memory: 27184K380gitlab # [ 0.595152] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.604072] thunder_xcv, ver 1.0382gitlab # [ 0.604178] thunder_bgx, ver 1.0383gitlab # [ 0.604248] nicpf, ver 1.0384gitlab # [ 0.605937] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.605949] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.606022] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.606037] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.606109] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.606118] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.606196] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.606207] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.606611] sky2: driver version 1.30393gitlab # [ 0.611830] usbcore: registered new interface driver usb-storage394gitlab # [ 0.612172] usbcore: registered new interface driver usbserial_generic395gitlab # [ 0.612218] usbserial: USB Serial support registered for generic396gitlab # [ 0.612275] ehci-pci 0000:00:0a.0: EHCI Host Controller397gitlab # [ 0.612326] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1398gitlab # [ 0.612985] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000399gitlab # [ 0.614047] hv_vmbus: registering driver hyperv_keyboard400gitlab # [ 0.616631] rtc-pl031 9010000.pl031: registered as rtc0401gitlab # [ 0.616687] rtc-pl031 9010000.pl031: setting system clock to 2026-09-04T07:24:22 UTC (1788506662)402gitlab # [ 0.617593] i2c_dev: i2c /dev entries driver403gitlab # [ 0.623081] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00404gitlab # [ 0.623878] hub 1-0:1.0: USB hub found405gitlab # [ 0.623937] hub 1-0:1.0: 6 ports detected406gitlab # [ 0.626176] sdhci: Secure Digital Host Controller Interface driver407gitlab # [ 0.626191] sdhci: Copyright(c) Pierre Ossman408gitlab # [ 0.627013] Synopsys Designware Multimedia Card Interface Driver409gitlab # [ 0.628236] sdhci-pltfm: SDHCI platform and OF driver helper410gitlab # [ 0.632986] hid: raw HID events driver (C) Jiri Kosina411gitlab # [ 0.633888] usbcore: registered new interface driver usbhid412gitlab # [ 0.633898] usbhid: USB HID core driver413gitlab # [ 0.645255] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.649987] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.650292] NET: Registered PF_INET6 protocol family416gitlab # [ 0.652026] Segment Routing with IPv6417gitlab # [ 0.652060] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.652126] NET: Registered PF_PACKET protocol family419gitlab # [ 0.652374] 9pnet: Installing 9P2000 support420gitlab # [ 0.656605] Key type dns_resolver registered421gitlab # [ 0.674551] registered taskstats version 1422gitlab # [ 0.675039] Loading compiled-in X.509 certificates423gitlab # [ 0.695242] Demotion targets for Node 0: null424gitlab # [ 0.695469] Key type .fscrypt registered425gitlab # [ 0.695476] Key type fscrypt-provisioning registered426gitlab # [ 0.695654] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.695676] ima: Allocated hash algorithm: sha1428gitlab # [ 0.695704] ima: No architecture policies found429gitlab # [ 0.696894] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.722941] clk: Disabling unused clocks431gitlab # [ 0.722997] PM: genpd: Disabling unused power domains432gitlab # [ 0.728023] Freeing unused kernel memory: 4736K433gitlab # [ 0.728239] Run /init as init process434gitlab # [ 0.758061] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 0.871049] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.029936] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.092542] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)438gitlab # [ 1.092610] systemd[1]: Detected virtualization qemu.439gitlab # [ 1.092687] systemd[1]: Detected architecture arm64.440gitlab # [ 1.092702] systemd[1]: Running in initrd.441gitlab # [ 1.093583] systemd[1]: Initializing machine ID from random generator.442gitlab # [ 1.093856] systemd[1]: Hostname set to <gitlab>.443gitlab # [ 1.155762] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0444gitlab # [ 1.275058] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.327611] systemd[1]: bpf-restrict-fs: LSM BPF program attached446gitlab # [ 1.414402] systemd[1]: Queued start job for default target Initrd Default Target.447gitlab # [ 1.429043] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2448gitlab # [ 1.429507] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0449gitlab # [ 1.430712] systemd[1]: Created slice Slice /system/modprobe.450gitlab # [ 1.431149] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.451gitlab # [ 1.431190] systemd[1]: Expecting device /dev/disk/by-label/nix-store...452gitlab # [ 1.431205] systemd[1]: Expecting device /dev/disk/by-label/nixos...453gitlab # [ 1.431232] systemd[1]: Reached target Path Units.454gitlab # [ 1.431250] systemd[1]: Reached target Slice Units.455gitlab # [ 1.431268] systemd[1]: Reached target Swaps.456gitlab # [ 1.431290] systemd[1]: Reached target Timer Units.457gitlab # [ 1.431482] systemd[1]: Listening on D-Bus System Message Bus Socket.458gitlab # [ 1.431682] systemd[1]: Listening on Journal Socket (/dev/log).459gitlab # [ 1.431853] systemd[1]: Listening on Journal Sockets.460gitlab # [ 1.432018] systemd[1]: Listening on udev Control Socket.461gitlab # [ 1.432118] systemd[1]: Listening on udev Kernel Socket.462gitlab # [ 1.432139] systemd[1]: Reached target Socket Units.463gitlab # [ 1.434210] systemd[1]: Starting Create List of Static Device Nodes...464gitlab # [ 1.436200] systemd[1]: Starting Load Kernel Module 9pnet_virtio...465gitlab # [ 1.436273] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs466gitlab # [ 1.438581] systemd[1]: Mounting Kernel Configuration File System...467gitlab # [ 1.466367] systemd[1]: Starting Journal Service...468gitlab # [ 1.470646] systemd[1]: Starting Load Kernel Modules...469gitlab # [ 1.470934] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os470gitlab # [ 1.475346] systemd[1]: Starting Coldplug All udev Devices...471gitlab # [ 1.491738] systemd[1]: Finished Create List of Static Device Nodes.472gitlab # [ 1.493984] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.473gitlab # [ 1.494915] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 1.498693] systemd[1]: Mounted Kernel Configuration File System.475gitlab # [ 1.502765] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...476gitlab # [ 1.521796] systemd-journald[95]: Collecting audit messages is disabled.477gitlab # [ 1.531712] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0478gitlab # [ 1.531988] [drm] features: -virgl +edid -resource_blob -host_visible479gitlab # [ 1.532012] [drm] features: -context_init480gitlab # [ 1.533019] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.481gitlab # [ 1.535543] [drm] number of scanouts: 1482gitlab # [ 1.535575] [drm] number of cap sets: 0483gitlab # [ 1.536105] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev484gitlab # [ 1.540067] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic485gitlab # [ 1.540083] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0486gitlab # [ 1.551168] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.487gitlab # [ 1.555302] systemd[1]: Starting Create Static Device Nodes in /dev...488gitlab # [ 1.565099] Console: switching to colour frame buffer device 160x50489gitlab # [ 1.566181] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device490gitlab # [ 1.596859] systemd-modules-load[96]: Using 4 probe threads491gitlab # [ 1.600177] systemd[1]: Started Journal Service.492gitlab # [ 1.599820] systemd-modules-load[96]: Module 'virtio_balloon' is built in493gitlab # [ 1.602127] systemd-modules-load[96]: Module 'virtio_console' is built in494gitlab # [ 1.603422] systemd-modules-load[96]: Module 'virtio_rng' is built in495gitlab # [ 1.605211] systemd-modules-load[96]: Inserted module 'dm_mod'496gitlab # [ 1.606706] systemd-modules-load[96]: Inserted module 'virtio_gpu'497gitlab # [ 1.608774] systemd[1]: Finished Load Kernel Modules.498gitlab # [ 1.616242] systemd[1]: Starting Apply Kernel Variables...499gitlab # [ 1.622489] systemd[1]: Finished Create Static Device Nodes in /dev.500gitlab # [ 1.625387] systemd[1]: Reached target Preparation for Local File Systems.501gitlab # [ 1.628043] systemd[1]: Reached target Local File Systems.502gitlab # [ 1.639989] systemd[1]: Starting Create System Files and Directories...503gitlab # [ 1.641946] systemd[1]: Starting Rule-based Manager for Device Events and Files...504gitlab # [ 1.654145] systemd[1]: Finished Apply Kernel Variables.505gitlab # [ 1.668439] systemd[1]: Finished Create System Files and Directories.506gitlab # [ 1.695315] systemd-udevd[115]: Using default interface naming scheme 'v261'.507gitlab # [ 1.714679] systemd[1]: Started Rule-based Manager for Device Events and Files.508gitlab # [ 1.739047] systemd[1]: Starting Virtual Console Setup...509gitlab # [ 1.814288] systemd-vconsole-setup[130]: Configuration of first virtual console was skipped, ignoring remaining ones.510gitlab # [ 1.819438] systemd[1]: Finished Virtual Console Setup.511gitlab # [ 2.145823] systemd[1]: Finished Coldplug All udev Devices.512gitlab # [ 2.148500] systemd[1]: Reached target System Initialization.513gitlab # [ 2.151009] systemd[1]: Reached target Basic System.514gitlab # [ 2.348865] (udev-worker)[128]: Network interface NamePolicy= disabled on kernel command line.515gitlab # [ 2.371496] systemd[1]: Found device /dev/disk/by-label/nixos.516gitlab # [ 2.376418] (udev-worker)[122]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.517gitlab # [ 2.380089] (udev-worker)[122]: Network interface NamePolicy= disabled on kernel command line.518gitlab # [ 2.388376] systemd[1]: Found device /dev/disk/by-label/nix-store.519gitlab # [ 2.394108] systemd[1]: Reached target Initrd Root Device.520gitlab # [ 2.396157] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...521gitlab # [ 2.439086] systemd-fsck[152]: nixos: clean, 12/65536 files, 13019/262144 blocks522gitlab # [ 2.444782] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.523gitlab # [ 2.475677] systemd[1]: Mounting /sysroot...524gitlab # [ 2.517233] EXT4-fs (vda): mounted filesystem bd10af91-54df-4be3-b3fc-9020b5e74b1e r/w with ordered data mode. Quota mode: none.525gitlab # [ 2.518156] systemd[1]: Mounted /sysroot.526gitlab # [ 2.519351] systemd[1]: Reached target Initrd Root File System.527gitlab # [ 2.522204] systemd[1]: Starting Mountpoints Configured in the Real Root...528gitlab # [ 2.548267] systemd-sysroot-fstab-check[160]: /sysroot should be mounted in the initrd, will request daemon-reload.529gitlab # [ 2.550386] systemd[1]: Reload requested from client PID 160 ('systemd-sysroot') (unit initrd-parse-etc.service)...530gitlab # [ 2.552178] systemd[1]: Reloading...531gitlab # [ 2.652789] systemd[1]: Reloading finished in 102 ms.532gitlab # [ 2.705452] systemd-sysroot-fstab-check[160]: Requesting initrd-fs.target/start/replace...533gitlab # [ 2.710561] systemd-sysroot-fstab-check[160]: Requesting swap.target/start/replace...534gitlab # [ 2.711733] systemd[1]: Starting Load Kernel Module 9pnet_virtio...535gitlab # [ 2.715520] systemd[1]: initrd-parse-etc.service: Deactivated successfully.536gitlab # [ 2.728188] systemd[1]: Finished Mountpoints Configured in the Real Root.537gitlab # [ 2.729584] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.538gitlab # [ 2.735905] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.539gitlab # [ 2.737133] systemd[1]: Finished Load Kernel Module 9pnet_virtio.540gitlab # [ 2.875651] (udev-worker)[145]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory541gitlab # [ 2.879088] (udev-worker)[145]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory542gitlab # [ 2.887724] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.543gitlab # [ 2.889020] systemd[1]: Stopped Virtual Console Setup.544gitlab # [ 2.889766] systemd[1]: Stopping Virtual Console Setup...545gitlab # [ 2.890528] systemd[1]: Starting Virtual Console Setup...546gitlab # [ 2.920919] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.547gitlab # [ 2.922126] systemd[1]: Stopped Virtual Console Setup.548gitlab # [ 2.922923] systemd[1]: Starting Virtual Console Setup...549gitlab # [ 2.950553] systemd-vconsole-setup[183]: Configuration of first virtual console was skipped, ignoring remaining ones.550gitlab # [ 2.953366] systemd[1]: Finished Virtual Console Setup.551gitlab # [ 3.481667] systemd[1]: Mounting /sysroot/nix/.ro-store...552gitlab # [ 3.485256] systemd[1]: Mounting /sysroot/nix/.rw-store...553gitlab # [ 3.488756] systemd[1]: Mounting /sysroot/run...554gitlab # [ 3.504238] systemd[1]: Mounting /sysroot/tmp/shared...555gitlab # [ 3.516511] systemd[1]: Mounting /sysroot/tmp/xchg...556gitlab # [ 3.535658] systemd[1]: Mounted /sysroot/nix/.rw-store.[ 3.540490] erofs (device vdb): mounted with root inode @ nid 128.557gitlab # 558gitlab # [ 3.541845] systemd[1]: Mounted /sysroot/run.559gitlab # [ 3.544559] systemd[1]: Mounted /sysroot/nix/.ro-store.560gitlab # [ 3.550443] systemd[1]: Mounted /sysroot/tmp/shared.561gitlab # [ 3.555331] systemd[1]: Starting rw-sysroot-nix-store.service...562gitlab # [ 3.564921] systemd[1]: Mounted /sysroot/tmp/xchg.563gitlab # [ 3.581486] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.564gitlab # [ 3.584599] systemd[1]: Finished rw-sysroot-nix-store.service.565gitlab # [ 4.479306] systemd[1]: Mounting /sysroot/nix/store...566gitlab # [ 4.547739] systemd[1]: Mounted /sysroot/nix/store.567gitlab # [ 4.550128] systemd[1]: Reached target Initrd File Systems.568gitlab # [ 4.552656] systemd[1]: Starting Find NixOS closure...569gitlab # [ 4.556095] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...570gitlab # [ 4.613921] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.571gitlab # [ 4.617742] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.572gitlab # [ 4.634746] systemd[1]: Finished Find NixOS closure.573gitlab # [ 4.637077] systemd[1]: Reached target Initrd Default Target.574gitlab # [ 4.639585] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...575gitlab # [ 4.694550] systemd[1]: Stopped target Initrd Default Target.576gitlab # [ 4.697234] systemd[1]: Stopped target Basic System.577gitlab # [ 4.699430] systemd[1]: Stopped target Initrd Root Device.578gitlab # [ 4.701928] systemd[1]: Stopped target Path Units.579gitlab # [ 4.704098] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.580gitlab # [ 4.707487] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.581gitlab # [ 4.710924] systemd[1]: Stopped target Slice Units.582gitlab # [ 4.713234] systemd[1]: Stopped target Socket Units.583gitlab # [ 4.715427] systemd[1]: Stopped target System Initialization.584gitlab # [ 4.718014] systemd[1]: Stopped target Swaps.585gitlab # [ 4.720000] systemd[1]: Stopped target Timer Units.586gitlab # [ 4.722192] systemd[1]: dbus.socket: Deactivated successfully.587gitlab # [ 4.724758] systemd[1]: Closed D-Bus System Message Bus Socket.588gitlab # [ 4.732874] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.589gitlab # [ 4.740216] systemd[1]: Stopped Find NixOS closure.590gitlab # [ 4.742424] systemd[1]: Starting Load Kernel Module 9pnet_virtio...591gitlab # [ 4.745176] systemd[1]: Starting rw-sysroot-nix-store.service...592gitlab # [ 4.747207] systemd[1]: systemd-sysctl.service: Deactivated successfully.593gitlab # [ 4.749623] systemd[1]: Stopped Apply Kernel Variables.594gitlab # [ 4.751263] systemd[1]: systemd-modules-load.service: Deactivated successfully.595gitlab # [ 4.753671] systemd[1]: Stopped Load Kernel Modules.596gitlab # [ 4.755124] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.597gitlab # [ 4.757553] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.598gitlab # [ 4.759613] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.599gitlab # [ 4.761610] systemd[1]: Stopped Create System Files and Directories.600gitlab # [ 4.763186] systemd[1]: Stopped target Local File Systems.601gitlab # [ 4.764694] systemd[1]: Stopped target Preparation for Local File Systems.602gitlab # [ 4.766355] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.603gitlab # [ 4.768088] systemd[1]: Stopped Coldplug All udev Devices.604gitlab # [ 4.769389] systemd[1]: Stopping Rule-based Manager for Device Events and Files...605gitlab # [ 4.771123] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.606gitlab # [ 4.773012] systemd[1]: Stopped Virtual Console Setup.607gitlab # [ 4.774202] systemd[1]: initrd-cleanup.service: Deactivated successfully.608gitlab # [ 4.775706] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.609gitlab # [ 4.777292] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.610gitlab # [ 4.778932] systemd[1]: Finished Load Kernel Module 9pnet_virtio.611gitlab # [ 4.780331] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.612gitlab # [ 4.781942] systemd[1]: Finished rw-sysroot-nix-store.service.613gitlab # [ 4.783254] systemd[1]: systemd-udevd.service: Deactivated successfully.614gitlab # [ 4.784803] systemd[1]: Stopped Rule-based Manager for Device Events and Files.615gitlab # [ 4.786398] systemd[1]: systemd-udevd.service: Consumed 2.138s CPU time over 3.128s wall clock time, 30.4M memory peak.616gitlab # [ 4.788750] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.617gitlab # [ 4.790338] systemd[1]: Closed udev Control Socket.618gitlab # [ 4.791462] systemd[1]: Starting Cleanup udev Database...619gitlab # [ 4.792765] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.620gitlab # [ 4.794432] systemd[1]: Stopped Create Static Device Nodes in /dev.621gitlab # [ 4.795818] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.622gitlab # [ 4.797727] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.623gitlab # [ 4.799357] systemd[1]: kmod-static-nodes.service: Deactivated successfully.624gitlab # [ 4.800972] systemd[1]: Stopped Create List of Static Device Nodes.625gitlab # [ 4.891524] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.626gitlab # [ 4.894921] systemd[1]: Finished Cleanup udev Database.627gitlab # [ 4.897310] systemd[1]: Reached target Switch Root.628gitlab # [ 4.899448] systemd[1]: Starting NixOS Activation...629gitlab # [ 5.106369] initrd-nixos-activation-start[224]: booting system configuration /nix/store/2lq549hlmr3awhzdqzdkn3yyjrvd3hqq-nixos-system-gitlab-test630gitlab # [ 5.172294] initrd-nixos-activation-start[224]: running activation script...631gitlab # [ 5.496493] initrd-nixos-activation-start[247]: setting up /etc...632gitlab # [ 5.633375] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.633gitlab # [ 5.636788] systemd[1]: Finished NixOS Activation.634gitlab # [ 5.638888] systemd[1]: Starting Switch Root...635gitlab # [ 5.683118] systemd[1]: Switching root.636gitlab # [ 5.776476] systemd-journald[95]: Received SIGTERM from PID 1 (systemd).637gitlab # [ 6.412638] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)638gitlab # [ 6.412797] systemd[1]: Detected virtualization qemu.639gitlab # [ 6.412879] systemd[1]: Detected architecture arm64.640gitlab # [ 6.413066] systemd[1]: Detected first boot.641gitlab # [ 6.414495] systemd[1]: Initializing machine ID from random generator.642gitlab # [ 6.643707] systemd[1]: bpf-restrict-fs: LSM BPF program attached643gitlab # [ 6.750507] systemd[1]: Applying preset policy.644gitlab # [ 6.915848] systemd[1]: Populated /etc with preset unit settings.645gitlab # [ 7.070072] systemd[1]: initrd-switch-root.service: Deactivated successfully.646gitlab # [ 7.070495] systemd[1]: Stopped initrd-switch-root.service.647gitlab # [ 7.073094] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.648gitlab # [ 7.078169] systemd[1]: Created slice Slice /system/getty.649gitlab # [ 7.085741] systemd[1]: Created slice GitLab DevOps Platform Slice.650gitlab # [ 7.089494] systemd[1]: Created slice User and Session Slice.651gitlab # [ 7.089727] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.652gitlab # [ 7.090668] systemd[1]: Started Forward Password Requests to Wall Directory Watch.653gitlab # [ 7.095267] systemd[1]: Expecting device /dev/hvc0...654gitlab # [ 7.095347] systemd[1]: Expecting device /dev/ttyAMA0...655gitlab # [ 7.096324] systemd[1]: Reached target Local Encrypted Volumes.656gitlab # [ 7.097078] systemd[1]: Stopped target initrd-fs.target.657gitlab # [ 7.097811] systemd[1]: Stopped target initrd-root-fs.target.658gitlab # [ 7.098518] systemd[1]: Stopped target initrd-switch-root.target.659gitlab # [ 7.099543] systemd[1]: Reached target Virtual Machines and Containers.660gitlab # [ 7.100669] systemd[1]: Reached target Path Units.661gitlab # [ 7.101773] systemd[1]: Reached target Remote File Systems.662gitlab # [ 7.102882] systemd[1]: Reached target Slice Units.663gitlab # [ 7.104002] systemd[1]: Reached target Swaps.664gitlab # [ 7.108158] systemd[1]: Listening on Query the User Interactively for a Password.665gitlab # [ 7.112469] systemd[1]: Listening on Process Core Dump Socket.666gitlab # [ 7.115615] systemd[1]: Listening on Credential Encryption/Decryption.667gitlab # [ 7.119317] systemd[1]: Listening on Factory Reset Management.668gitlab # [ 7.120701] systemd[1]: Listening on Hostname Service Socket.669gitlab # [ 7.132105] systemd[1]: Starting Journal Log Access Socket...670gitlab # [ 7.134385] systemd[1]: Listening on Journal Audit Socket.671gitlab # [ 7.138532] systemd[1]: Listening on Console Output Muting Service Socket.672gitlab # [ 7.140270] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.673gitlab # [ 7.141399] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os674gitlab # [ 7.142374] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki675gitlab # [ 7.149119] systemd[1]: Listening on Disk Repartitioning Service Socket.676gitlab # [ 7.150677] systemd[1]: Listening on udev Control Socket.677gitlab # [ 7.152233] systemd[1]: Listening on udev Varlink Socket.678gitlab # [ 7.160595] systemd[1]: Mounting Huge Pages File System...679gitlab # [ 7.171312] systemd[1]: Mounting POSIX Message Queue File System...680gitlab # [ 7.180082] systemd[1]: Mounting Kernel Debug File System...681gitlab # [ 7.188410] systemd[1]: Mounting Kernel Trace File System...682gitlab # [ 7.199288] systemd[1]: Starting Create List of Static Device Nodes...683gitlab # [ 7.211269] systemd[1]: Starting Load Kernel Module 9pnet_virtio...684gitlab # [ 7.212311] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs685gitlab # [ 7.221926] systemd[1]: Mounting Kernel Configuration File System...686gitlab # [ 7.222888] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm687gitlab # [ 7.223919] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore688gitlab # [ 7.233440] systemd[1]: Starting Load Kernel Module fuse...689gitlab # [ 7.234405] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67690gitlab # [ 7.243302] systemd[1]: Starting Journal Service...691gitlab # [ 7.251176] systemd[1]: Starting Load Kernel Modules...692gitlab # [ 7.255267] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...693gitlab # [ 7.263310] systemd[1]: Starting Remount Root and Kernel File Systems...694gitlab # [ 7.264080] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os695gitlab # [ 7.279571] systemd[1]: Starting Coldplug All udev Devices...696gitlab # [ 7.281885] fuse: init (API version 7.45)697gitlab # [ 7.287887] systemd[1]: Listening on Journal Log Access Socket.698gitlab # [ 7.288715] systemd[1]: Mounted Huge Pages File System.699gitlab # [ 7.289677] systemd[1]: Mounted POSIX Message Queue File System.700gitlab # [ 7.290518] systemd[1]: Mounted Kernel Debug File System.701gitlab # [ 7.303511] systemd[1]: Queued start job for default target Multi-User System.702gitlab # [ 7.305507] systemd[1]: Unnecessary job was removed for /dev/vdb.703gitlab # [ 7.307614] systemd[1]: systemd-journald.service: Deactivated successfully.[ 7.291519] systemd[1]: Mounted Kernel Trace File System.704gitlab # [ 7.291980] systemd-journald[318]: Collecting audit messages is enabled.705gitlab # 706gitlab # [ 7.293671] systemd[1]: Finished Create List of Static Device Nodes.707gitlab # [ 7.295197] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.708gitlab # [ 7.296238] systemd[1]: Finished Load Kernel Module 9pnet_virtio.709gitlab # [ 7.297150] systemd[1]: Mounted Kernel Configuration File System.710gitlab # [ 7.317245] systemd-modules-load[319]: Using 3 probe threads[ 7.298122] systemd[1]: modprobe@fuse.service: Deactivated successfully.711gitlab # 712gitlab # [ 7.299071] systemd[1]: Finished Load Kernel Module fuse.713gitlab # [ 7.300315] systemd[1]: Finished Load Kernel Modules.714gitlab # [ 7.308236] systemd[1]: Mounting FUSE Control File System...715gitlab # [ 7.319287] EXT4-fs (vda): re-mounted bd10af91-54df-4be3-b3fc-9020b5e74b1e.716gitlab # [ 7.327598] systemd-modules-load[319]: Module 'atkbd' is built in[ 7.321973] systemd[1]: Starting Firewall...717gitlab # 718gitlab # [ 7.333075] systemd-modules-load[319]: Module 'loop' is built in719gitlab # [ 7.334274] systemd-modules-load[319]: Inserted module 'tls'720gitlab # [ 7.346291] systemd[1]: Starting Apply Kernel Variables...721gitlab # [ 7.351150] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...722gitlab # [ 7.353307] systemd[1]: Started Journal Service.723gitlab # [ 7.353991] systemd[1]: Finished Remount Root and Kernel File Systems.724gitlab # [ 7.355770] systemd[1]: Mounted FUSE Control File System.725gitlab # [ 7.369553] systemd[1]: Listening on Disk Image Download Service Socket.726gitlab # [ 7.372656] systemd-oomd[321]: No swap; memory pressure usage will be degraded727gitlab # [ 7.383414] systemd[1]: Starting Flush Journal to Persistent Storage...728gitlab # [ 7.384728] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore729gitlab # [ 7.386613] systemd[1]: Starting Load/Save OS Random Seed...730gitlab # [ 7.387562] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os731gitlab # [ 7.392068] systemd-journald[318]: Received client request to flush runtime journal.732gitlab # [ 7.431556] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.733gitlab # [ 7.433909] systemd[1]: Finished Apply Kernel Variables.734gitlab # [ 7.434926] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.735gitlab # [ 7.436578] systemd[1]: Starting Create Static Device Nodes in /dev...736gitlab # [ 7.437631] systemd[1]: Finished Load/Save OS Random Seed.737gitlab # [ 7.438451] systemd[1]: Reached target First Boot Complete.738gitlab # [ 7.439297] systemd[1]: Finished Create Static Device Nodes in /dev.739gitlab # [ 7.440519] systemd[1]: Finished Flush Journal to Persistent Storage.740gitlab # [ 7.441614] systemd[1]: Reached target Preparation for Local File Systems.741gitlab # [ 7.442602] systemd[1]: Starting Rule-based Manager for Device Events and Files...742gitlab # [ 7.511900] systemd-udevd[367]: Using default interface naming scheme 'v261'.743gitlab # [ 7.549605] systemd[1]: Started Rule-based Manager for Device Events and Files.744gitlab # [ 7.733170] systemd[1]: Finished Firewall.745gitlab # [ 7.922844] systemd[1]: Finished Coldplug All udev Devices.746gitlab # [ 8.009577] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs747gitlab # [ 8.065047] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.748gitlab # [ 8.092059] systemd[1]: Mounting /run/wrappers...749gitlab # [ 8.124162] (udev-worker)[421]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.750gitlab # [ 8.128935] (udev-worker)[421]: Network interface NamePolicy= disabled on kernel command line.751gitlab # [ 8.134509] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.752gitlab # [ 8.139135] systemd[1]: Mounted /run/wrappers.753gitlab # [ 8.140331] systemd[1]: Reached target Local File Systems.754gitlab # [ 8.141865] systemd[1]: Listening on Boot Loader Control Service Socket.755gitlab # [ 8.146113] (udev-worker)[412]: Network interface NamePolicy= disabled on kernel command line.756gitlab # [ 8.149154] systemd[1]: Starting register-nix-paths.service...757gitlab # [ 8.152995] systemd[1]: Starting Create SUID/SGID Wrappers...758gitlab # [ 8.154069] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.759gitlab # [ 8.159847] systemd[1]: Starting Save Transient machine-id to Disk...760gitlab # [ 8.166042] systemd[1]: Starting Create System Files and Directories...761gitlab # [ 8.170632] systemd[1]: Condition check resulted in Virtio network device being skipped.762gitlab # [ 8.179978] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore763gitlab # [ 8.184371] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.764gitlab # [ 8.187960] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67765gitlab # [ 8.193008] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore766gitlab # [ 8.196358] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os767gitlab # [ 8.199563] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os768gitlab # [ 8.210517] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.769gitlab # [ 8.214985] systemd[1]: Finished Save Transient machine-id to Disk.770gitlab # [ 8.236085] systemd[1]: Finished Create System Files and Directories.771gitlab # [ 8.243466] systemd[1]: Starting Rebuild Journal Catalog...772gitlab # [ 8.248763] systemd[1]: Starting Record System Boot/Shutdown in UTMP...773gitlab # [ 8.273230] systemd[1]: Finished Record System Boot/Shutdown in UTMP.774gitlab # [ 8.286301] mousedev: PS/2 mouse device common for all mice775gitlab # [ 8.291807] systemd[1]: Finished Rebuild Journal Catalog.776gitlab # [ 8.296670] systemd[1]: Starting Update is Completed...777gitlab # [ 8.324302] systemd[1]: Finished Update is Completed.778gitlab # [ 8.351174] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.779gitlab # [ 8.353555] systemd[1]: Finished Create SUID/SGID Wrappers.780gitlab # [ 8.355053] systemd[1]: suid-sgid-wrappers.service: Consumed 135ms CPU time over 198ms wall clock time, 6.3M memory peak, 1.9M read from disk.781gitlab # [ 8.638481] systemd[1]: Finished register-nix-paths.service.782gitlab # [ 8.640697] systemd[1]: Reached target System Initialization.783gitlab # [ 8.641849] systemd[1]: Started Discard unused filesystem blocks once a week.784gitlab # [ 8.643814] systemd[1]: Started logrotate.timer.785gitlab # [ 8.646058] systemd[1]: Started Daily Cleanup of Temporary Directories.786gitlab # [ 8.647145] systemd[1]: Reached target Timer Units.787gitlab # [ 8.647976] systemd[1]: Listening on D-Bus System Message Bus Socket.788gitlab # [ 8.649407] systemd[1]: Listening on Nix Daemon Socket.789gitlab # [ 8.668114] systemd[1]: Starting nixbot CI service socket...790gitlab # [ 8.669120] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.791gitlab # [ 8.672178] systemd[1]: Listening on nixbot CI service socket.792gitlab # [ 8.673162] systemd[1]: Reached target Socket Units.793gitlab # [ 8.692314] systemd[1]: Starting D-Bus System Message Bus...794gitlab # [ 8.757983] dbus-broker-launch[562]: Looking up NSS user entry for 'systemd-timesync'...795gitlab # [ 8.759316] dbus-broker-launch[562]: NSS returned no entry for 'systemd-timesync'[ 8.763067] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3796gitlab # 797gitlab # [ 8.763474] dbus-broker-launch[562]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"798gitlab # [ 8.766284] systemd[1]: Started D-Bus System Message Bus.799gitlab # [ 8.779616] dbus-broker-launch[562]: Ready800gitlab # [ 8.780606] systemd[1]: Reached target Basic System.801gitlab # [ 8.783292] systemd[1]: Started backdoor.service.802gitlab # [ 8.813812] systemd[1]: Starting gitlab-config.service...803gitlab # [ 8.815541] systemd[1]: Starting Import lastlog data into lastlog2 database...804gitlab # [ 8.826702] systemd[1]: Starting Logrotate configuration check...805gitlab # [ 8.827881] systemd[1]: Starting Name Service Cache Daemon (nsncd)...806gitlab # connecting to host...807gitlab # [ 8.833282] systemd[1]: Starting Post-Boot Actions...808gitlab # [ 8.834222] systemd[1]: Started Reset console on configuration changes.809gitlab # [ 8.849580] logrotate[572]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.810gitlab # [ 8.851686] logrotate[572]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf811gitlab # [ 8.853067] logrotate[572]: note: 'monthly' overrides previously specified 'weekly'812gitlab: Guest shell says: b'Spawning backdoor root shell...\n'813gitlab # [ 8.854155] logrotate[572]: Reading state from file: /var/lib/logrotate.status814gitlab # [ 8.857940] logrotate[572]: state file /var/lib/logrotate.status does not exist815gitlab # [ 8.859015] logrotate[572]: Allocating hash table for state file, size 64 entries816gitlab: connected to guest root shell817gitlab # [ 8.859983] logrotate[572]: Handling 4 logs818gitlab: (connecting took 9.32 seconds)819gitlab # [ 8.860787] logrotate[572]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed820gitlab: (finished: waiting for the VM to finish booting, in 9.32 seconds)821gitlab # [ 8.862875] logrotate[572]: considering log /var/log/btmp822gitlab # [ 8.863732] logrotate[572]: Creating new state823gitlab # [ 8.867427] logrotate[572]: Now: 2026-09-04 07:24824gitlab # [ 8.868072] logrotate[572]: Last rotated at 2026-09-04 07:00825gitlab # [ 8.868800] logrotate[572]: log does not need rotating (log has already been rotated)826gitlab # [ 8.869793] logrotate[572]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed827gitlab # [ 8.871894] logrotate[572]: considering log /var/log/wtmp828gitlab # [ 8.873051] logrotate[572]: Creating new state829gitlab # [ 8.876174] logrotate[572]: Now: 2026-09-04 07:24830gitlab # [ 8.876951] logrotate[572]: Last rotated at 2026-09-04 07:00831gitlab # [ 8.877714] logrotate[572]: log does not need rotating (log has already been rotated)832gitlab # [ 8.880444] logrotate[572]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed833gitlab # [ 8.882245] logrotate[572]: switching euid from 0 to 165 and egid from 0 to 165 (pid 572)834gitlab # [ 8.883373] logrotate[572]: considering log /var/gitlab/state/log/*.log835gitlab # [ 8.884464] logrotate[572]: log /var/gitlab/state/log/*.log does not exist -- skipping836gitlab # [ 8.886599] logrotate[572]: Creating new state837gitlab # [ 8.887351] logrotate[572]: switching euid from 165 to 0 and egid from 165 to 0 (pid 572)838gitlab # [ 8.888624] logrotate[572]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed839gitlab # [ 8.890211] logrotate[572]: switching euid from 0 to 60 and egid from 0 to 60 (pid 572)840gitlab # [ 8.891214] logrotate[572]: considering log /var/log/nginx/*.log841gitlab # [ 8.891990] logrotate[572]: log /var/log/nginx/*.log does not exist -- skipping842gitlab # [ 8.892976] logrotate[572]: Creating new state843gitlab # [ 8.893577] logrotate[572]: not running postrotate script, since no logs were rotated844gitlab # [ 8.894566] logrotate[572]: switching euid from 60 to 0 and egid from 60 to 0 (pid 572)845gitlab # [ 8.895982] nsncd[573]: Sep 04 07:24:30.752 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"846gitlab # [ 8.898240] systemd[1]: Starting resolvconf update...847gitlab # [ 8.899095] systemd[1]: Finished Logrotate configuration check.848gitlab # [ 8.900074] systemd[1]: Started Name Service Cache Daemon (nsncd).849gitlab # [ 8.901064] systemd[1]: Finished Post-Boot Actions.850gitlab # [ 8.901768] systemd[1]: Finished Import lastlog data into lastlog2 database.851gitlab # [ 8.902706] systemd[1]: Reached target Host and Network Name Lookups.852gitlab # [ 8.903572] systemd[1]: Reached target User and Group Name Lookups.853gitlab # [ 8.910416] systemd[1]: Starting User Login Management...854gitlab # [ 8.916377] systemd[1]: Starting Virtual Console Setup...855gitlab # [ 8.954586] systemd[1]: Stopped target Host and Network Name Lookups.856gitlab # [ 8.956094] systemd[1]: Stopping Host and Network Name Lookups...857gitlab # [ 8.958898] systemd[1]: Stopped target User and Group Name Lookups.858gitlab # [ 8.960731] systemd[1]: Stopping User and Group Name Lookups...859gitlab # [ 8.961761] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...860gitlab # [ 8.963189] systemd[1]: nscd.service: Deactivated successfully.861gitlab # [ 8.968354] systemd[1]: Stopped Name Service Cache Daemon (nsncd).862gitlab # [ 8.969285] systemd[1]: nscd.service: Consumed 22ms CPU time over 137ms wall clock time, 7.7M memory peak, 5.8M read from disk.863gitlab # [ 8.971074] systemd-logind[622]: New seat seat0.864gitlab # [ 8.971821] systemd[1]: Starting Name Service Cache Daemon (nsncd)...865gitlab # [ 8.972848] systemd-logind[622]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)866gitlab # [ 8.974030] systemd-logind[622]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)867gitlab # [ 8.975281] systemd-logind[622]: Watching system buttons on /dev/input/event0 (gpio-keys)868gitlab # [ 8.976452] systemd[1]: Started User Login Management.869gitlab # [ 8.982443] systemd-vconsole-setup[625]: Configuration of first virtual console was skipped, ignoring remaining ones.870gitlab # [ 8.989069] systemd[1]: Starting linger-users.service...871gitlab # [ 8.992274] systemd[1]: Finished Virtual Console Setup.872gitlab # [ 8.999585] systemd[1]: Started Name Service Cache Daemon (nsncd).873gitlab # [ 9.001294] nsncd[663]: Sep 04 07:24:30.886 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"874gitlab # [ 9.003493] systemd[1]: Finished resolvconf update.875gitlab # [ 9.004548] systemd[1]: Reached target Preparation for Network.876gitlab # [ 9.005418] systemd[1]: Reached target Host and Network Name Lookups.877gitlab # [ 9.006385] systemd[1]: Reached target User and Group Name Lookups.878gitlab # [ 9.007658] systemd[1]: Starting DHCP Client...879gitlab # [ 9.011881] systemd[1]: Starting Address configuration of eth1...880gitlab # [ 9.014643] systemd[1]: Starting Extra networking commands....881gitlab # [ 9.017469] systemd[1]: linger-users.service: Deactivated successfully.882gitlab # [ 9.019249] systemd[1]: Finished linger-users.service.883gitlab # [ 9.046690] network-addresses-eth1-start[690]: adding address 192.168.1.1/24... done884gitlab # [ 9.052115] network-addresses-eth1-start[690]: adding address 2001:db8:1::1/64... done885gitlab # [ 9.061020] systemd[1]: Finished Address configuration of eth1.886gitlab # [ 9.096248] dhcpcd[705]: dhcpcd-10.3.2 starting887gitlab # [ 9.098932] dhcpcd[755]: dev: loaded udev888gitlab # [ 9.099612] systemd[1]: Finished Extra networking commands..889gitlab # [ 9.100455] systemd[1]: Reached target Network.890gitlab # [ 9.104221] systemd[1]: Starting gitlab-workhorse.service...891gitlab # [ 9.106759] systemd[1]: Starting Nginx Web Server...892gitlab # [ 9.115264] 8021q: 802.1Q VLAN Support v1.8893gitlab # [ 9.115689] 8021q: adding VLAN 0 to HW filter on device eth1894gitlab # [ 9.115332] systemd[1]: Starting PostgreSQL Server...895gitlab # [ 9.120090] systemd[1]: Starting Redis Server - redis-gitlab...896gitlab # [ 9.129497] systemd[1]: Starting Permit User Sessions...897gitlab # [ 9.137697] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.898gitlab # [ 9.160218] cfg80211: Loading compiled-in X.509 certificates for regulatory database899gitlab # [ 9.169620] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'900gitlab # [ 9.170112] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'901gitlab # [ 9.171833] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2902gitlab # [ 9.172152] cfg80211: failed to load regulatory.db903gitlab # [ 9.176739] systemd[1]: Finished Permit User Sessions.904gitlab # [ 9.187585] systemd[1]: Started Getty on tty1.905gitlab # [ 9.188478] systemd[1]: Reached target Login Prompts.906gitlab # [ 9.215844] 8021q: adding VLAN 0 to HW filter on device eth0907gitlab # [ 9.215791] dhcpcd[755]: eth0: waiting for carrier908gitlab # [ 9.216844] dhcpcd[755]: eth0: carrier acquired909gitlab # [ 9.226180] dhcpcd[755]: DUID 00:01:00:01:32:2d:2e:af:52:54:00:12:34:56910gitlab # [ 9.227537] dhcpcd[755]: eth0: IAID 00:12:34:56911gitlab # [ 9.228552] dhcpcd[755]: eth0: adding address fe80::5054:ff:fe12:3456912gitlab # [ 9.290799] nginx-pre-start[794]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok913gitlab # [ 9.292856] nginx-pre-start[794]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful914gitlab # [ 9.298396] systemd[1]: Started Nginx Web Server.915gitlab # [ 9.325774] postgresql-pre-start[793]: The files belonging to this database system will be owned by user "postgres".916gitlab # [ 9.327584] postgresql-pre-start[793]: This user must also own the server process.917gitlab # [ 9.329486] redis-server[790]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.918gitlab # [ 9.331729] redis-server[790]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo919gitlab # [ 9.333245] systemd[1]: Started Redis Server - redis-gitlab.920gitlab # [ 9.334143] postgresql-pre-start[793]: The database cluster will be initialized with locale "en_US.UTF-8".921gitlab # [ 9.335431] postgresql-pre-start[793]: The default database encoding has accordingly been set to "UTF8".922gitlab # [ 9.336832] postgresql-pre-start[793]: The default text search configuration will be set to "english".923gitlab # [ 9.339381] postgresql-pre-start[793]: Data page checksums are enabled.924gitlab # [ 9.340531] postgresql-pre-start[793]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok925gitlab # [ 9.341837] redis-server[790]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=790, just started926gitlab # [ 9.343366] postgresql-pre-start[793]: creating subdirectories ... ok927gitlab # [ 9.344531] postgresql-pre-start[793]: selecting dynamic shared memory implementation ... posix928gitlab # [ 9.345671] redis-server[790]: Configuration loaded929gitlab # [ 9.346478] redis[790]: monotonic clock: ARM CNTVCT @ 1000 ticks/us930gitlab # [ 9.347448] redis[790]: Running mode=standalone, port=0.931gitlab # [ 9.348429] redis[790]: Server initialized932gitlab # [ 9.349261] redis[790]: Ready to accept connections unix933gitlab # [ 9.350172] redis[790]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.934gitlab # [ 9.377307] postgresql-pre-start[793]: selecting default "max_connections" ... 100935gitlab # [ 9.426487] postgresql-pre-start[793]: selecting default "shared_buffers" ... 128MB936gitlab # [ 9.731332] systemd[1]: Started gitlab-workhorse.service.937gitlab # [ 9.900402] postgresql-pre-start[793]: selecting default time zone ... UTC938gitlab # [ 9.903446] postgresql-pre-start[793]: creating configuration files ... ok939gitlab # [ 9.959340] gitlab-workhorse[816]: time="2026-09-04T07:24:31Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4940gitlab # [ 9.961209] gitlab-workhorse[816]: time="2026-09-04T07:24:31Z" level=info msg="Using redis/go-redis"941gitlab # [ 9.962371] gitlab-workhorse[816]: time="2026-09-04T07:24:31Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix942gitlab # [ 10.156638] postgresql-pre-start[793]: running bootstrap script ... ok943gitlab # [ 10.464187] dhcpcd[755]: eth0: soliciting a DHCP lease944gitlab # [ 10.481049] dhcpcd[755]: eth0: offered 10.0.2.15 from 10.0.2.2945gitlab # [ 10.500580] dhcpcd[755]: eth0: probing address 10.0.2.15/24946gitlab # [ 10.879327] postgresql-pre-start[793]: performing post-bootstrap initialization ... ok947gitlab # [ 11.161095] postgresql-pre-start[793]: syncing data to disk ... ok948gitlab # [ 11.163877] postgresql-pre-start[793]: initdb: warning: enabling "trust" authentication for local connections949gitlab # [ 11.168106] postgresql-pre-start[793]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.950gitlab # [ 11.174809] postgresql-pre-start[793]: Success. You can now start the database server using:951gitlab # [ 11.182308] postgresql-pre-start[793]: pg_ctl -D /var/lib/postgresql/18 -l logfile start952gitlab # [ 11.391690] postgres[850]: [850] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit953gitlab # [ 11.397536] postgres[850]: [850] LOG: listening on IPv6 address "::1", port 5432954gitlab # [ 11.400977] postgres[850]: [850] LOG: listening on IPv4 address "127.0.0.1", port 5432955gitlab # [ 11.405680] postgres[850]: [850] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"956gitlab # [ 11.412136] postgres[860]: [860] LOG: database system was shut down at 2026-09-04 07:24:32 GMT957gitlab # [ 11.423243] postgres[850]: [850] LOG: database system is ready to accept connections958gitlab # [ 11.429740] systemd[1]: Started PostgreSQL Server.959gitlab # [ 11.435555] systemd[1]: Starting PostgreSQL Setup Scripts...960gitlab # [ 11.504931] dhcpcd[755]: eth0: soliciting an IPv6 router961gitlab # [ 11.507402] dhcpcd[755]: eth0: Router Advertisement from fe80::2962gitlab # [ 11.510129] dhcpcd[755]: eth0: adding address fec0::5054:ff:fe12:3456/64963gitlab # [ 11.512939] dhcpcd[755]: eth0: adding route to fec0::/64964gitlab # [ 11.515254] dhcpcd[755]: eth0: adding default route via fe80::2965gitlab # [ 11.797893] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[876]: mkdir -p /var/gitlab/state/home/.ssh: OK966gitlab # [ 11.801891] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[876]: chmod 700 /var/gitlab/state/home/.ssh: OK967gitlab # [ 11.814183] postgresql-setup-start[871]: CREATE DATABASE968gitlab # [ 11.874039] systemd[1]: Finished gitlab-config.service.969gitlab # [ 11.875545] postgresql-setup-start[891]: CREATE ROLE970gitlab # [ 11.881846] systemd[1]: Started gitaly.service.971gitlab # [ 11.896507] postgresql-setup-start[895]: ALTER DATABASE972gitlab # [ 11.954505] postgresql-setup-start[902]: CREATE ROLE973gitlab # [ 11.959455] systemd[1]: Finished PostgreSQL Setup Scripts.974gitlab # [ 11.961961] systemd[1]: Reached target PostgreSQL.975gitlab # [ 11.966565] systemd[1]: Starting gitlab-db-config.service...976gitlab # [ 11.971901] systemd[1]: Starting gitlab-postgresql.service...977gitlab # [ 12.184316] gitlab-postgresql-start[917]: CREATE DATABASE978gitlab # [ 12.231816] gitlab-postgresql-start[933]: CREATE EXTENSION979gitlab # [ 12.328291] gitlab-postgresql-start[935]: CREATE EXTENSION980gitlab # [ 12.332765] systemd[1]: Finished gitlab-postgresql.service.981gitlab # [ 12.558762] gitaly[896]: time="2026-09-04T07:24:34.444Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=896982gitlab # [ 12.568979] gitaly[896]: time="2026-09-04T07:24:34.445Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=896983gitlab # [ 12.570767] gitaly[896]: time="2026-09-04T07:24:34.445Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=896984gitlab # [ 12.574777] gitaly[896]: time="2026-09-04T07:24:34.445Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=896985gitlab # [ 12.576799] gitaly[896]: time="2026-09-04T07:24:34.445Z" level=info msg="Starting Gitaly" pid=896 version=986gitlab # [ 12.776763] gitaly[896]: time="2026-09-04T07:24:34.662Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=216 pid=896987gitlab # [ 12.778685] gitaly[896]: time="2026-09-04T07:24:34.662Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=896988gitlab # [ 12.780492] gitaly[896]: time="2026-09-04T07:24:34.663Z" level=info msg="finished initializing command factory" duration_ms=0 pid=896989gitlab # [ 12.782114] gitaly[896]: time="2026-09-04T07:24:34.663Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-896/git-exec-1539573877.d/git pid=896990gitlab # [ 12.788300] gitaly[896]: time="2026-09-04T07:24:34.670Z" level=info msg="finished detecting git version" duration_ms=7 pid=896991gitlab # [ 12.789899] gitaly[896]: time="2026-09-04T07:24:34.670Z" level=info msg="using Git version" pid=896 version=2.53.g992gitlab # [ 12.791368] gitaly[896]: time="2026-09-04T07:24:34.670Z" level=info msg="clearing disk cache object folder" pid=896 storage=default993gitlab # [ 12.792966] gitaly[896]: time="2026-09-04T07:24:34.671Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4161866841 pid=896 storage=default994gitlab # [ 12.795273] gitaly[896]: time="2026-09-04T07:24:34.671Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4161866841 pid=896 storage=default995gitlab # [ 12.798182] gitaly[896]: time="2026-09-04T07:24:34.671Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=896996gitlab # [ 12.801334] gitaly[896]: time="2026-09-04T07:24:34.671Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=896997gitlab # [ 12.803625] gitaly[896]: time="2026-09-04T07:24:34.671Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4161866841 clear_duration_ms=0 pid=896 storage=default998gitlab # [ 12.806257] gitaly[896]: time="2026-09-04T07:24:34.687Z" level=info msg="counting repositories" pid=896999gitlab # [ 12.807430] gitaly[896]: time="2026-09-04T07:24:34.687Z" level=info msg="starting to count repositories" pid=896 storage_path=/var/gitlab/state/repositories1000gitlab # [ 12.809290] gitaly[896]: time="2026-09-04T07:24:34.687Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=896 storage_path=/var/gitlab/state/repositories1001gitlab # [ 12.811277] gitaly[896]: time="2026-09-04T07:24:34.687Z" level=info msg="completed counting all repositories" counting_duration=0 pid=8961002gitlab # [ 12.813030] gitaly[896]: time="2026-09-04T07:24:34.687Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=8961003gitlab # [ 12.816098] gitaly[896]: time="2026-09-04T07:24:34.688Z" level=info msg="finished tempdir cleaner walk" pid=896 storage=default time_ms=01004gitlab # [ 12.817725] gitaly[896]: time="2026-09-04T07:24:34.688Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=896 schema=unix1005gitlab # [ 12.819680] gitaly[896]: time="2026-09-04T07:24:34.688Z" level=info msg="listening at address" address=/run/gitaly/gitaly-896/sock.d/intern pid=896 schema=unix1006gitlab # [ 12.821805] gitaly[896]: time="2026-09-04T07:24:34.689Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=8961007gitlab # [ 12.823308] gitaly[896]: time="2026-09-04T07:24:34.689Z" level=info msg="Started Gitaly" duration_ms=244 pid=8961008gitlab # [ 12.824644] gitaly[896]: time="2026-09-04T07:24:34.690Z" level=info msg="maintenance: daily scheduled" pid=896 scheduled="2026-09-04 12:00:00 +0000 UTC"1009gitlab # [ 12.826588] gitaly[896]: time="2026-09-04T07:24:34.690Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=8961010gitlab # [ 13.279499] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[908]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1011gitlab # [ 13.290012] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[908]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1012gitlab # [ 13.300174] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[908]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1013gitlab # [ 14.934677] dhcpcd[755]: eth0: leased 10.0.2.15 for 86400 seconds1014gitlab # [ 14.934983] dhcpcd[755]: eth0: adding route to 10.0.2.0/241015gitlab # [ 14.935175] dhcpcd[755]: eth0: adding default route via 10.0.2.21016gitlab # [ 15.116748] systemd[1]: Started DHCP Client.1017gitlab # [ 15.118761] systemd[1]: Reached target Network is Online.1018gitlab # [ 16.281173] gitaly[896]: time="2026-09-04T07:24:38.166Z" level=info msg="License database preloaded" duration_ms=3699 pid=8961019gitlab # [ 59.714736] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[908]: W, [2026-09-04T07:25:21.599314 #908] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1020gitlab # [ 60.037478] gitlab-workhorse[816]: time="2026-09-04T07:25:21Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1021gitlab # [ 62.736723] postgres[1443]: [1443] ERROR: relation "feature_gates" does not exist at character 5231022gitlab # [ 62.737206] postgres[1443]: [1443] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1023gitlab # [ 62.737347] postgres[1443]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1024gitlab # [ 62.737446] postgres[1443]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1025gitlab # [ 62.737571] postgres[1443]: attidentity AS identity,1026gitlab # [ 62.737684] postgres[1443]: attgenerated as attgenerated1027gitlab # [ 62.737814] postgres[1443]: FROM pg_attribute a1028gitlab # [ 62.737935] postgres[1443]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1029gitlab # [ 62.738058] postgres[1443]: LEFT JOIN pg_type t ON a.atttypid = t.oid1030gitlab # [ 62.738178] postgres[1443]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1031gitlab # [ 62.738319] postgres[1443]: WHERE a.attrelid = '"feature_gates"'::regclass1032gitlab # [ 62.738435] postgres[1443]: AND a.attnum > 0 AND NOT a.attisdropped1033gitlab # [ 62.738547] postgres[1443]: ORDER BY a.attnum1034gitlab # [ 62.738659] postgres[1443]:1035gitlab # [ 67.837552] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1494]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1036gitlab # [ 67.840556] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1494]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1037gitlab # [ 70.047251] gitlab-workhorse[816]: time="2026-09-04T07:25:31Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1038gitlab # [ 80.048115] gitlab-workhorse[816]: time="2026-09-04T07:25:41Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1039gitlab # [ 90.054956] gitlab-workhorse[816]: time="2026-09-04T07:25:51Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1040gitlab # [ 97.806183] postgres[1615]: [1615] ERROR: relation "table_without_models" does not exist1041gitlab # [ 97.808639] postgres[1615]: [1615] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1042gitlab # [ 100.065490] gitlab-workhorse[816]: time="2026-09-04T07:26:01Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1043gitlab # [ 110.074328] gitlab-workhorse[816]: time="2026-09-04T07:26:11Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1044gitlab # [ 120.085571] gitlab-workhorse[816]: time="2026-09-04T07:26:21Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1045gitlab # [ 130.089706] gitlab-workhorse[816]: time="2026-09-04T07:26:31Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1046gitlab # [ 130.488608] systemd[1]: Finished gitlab-db-config.service.1047gitlab # [ 130.492541] systemd[1]: Started gitlab-sidekiq.service.1048gitlab # [ 130.496679] systemd[1]: Starting gitlab.service...1049gitlab # [ 131.112292] bundle[2018]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1050gitlab # [ 131.118700] bundle[2018]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1051gitlab # [ 131.124897] bundle[2018]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1052gitlab # [ 136.385167] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-04T07:26:38.239Z","message":"Starting cluster with 1 processes"}1053gitlab # [ 136.531170] bundle[2018]: {"timestamp":"2026-09-04T07:26:38.378Z","pid":2018,"message":"* Enabling systemd notification integration"}1054gitlab # [ 136.536681] bundle[2018]: {"timestamp":"2026-09-04T07:26:38.416Z","pid":2018,"message":"Puma starting in cluster mode..."}1055gitlab # [ 136.542835] bundle[2018]: {"timestamp":"2026-09-04T07:26:38.416Z","pid":2018,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1056gitlab # [ 136.547853] bundle[2018]: {"timestamp":"2026-09-04T07:26:38.416Z","pid":2018,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1057gitlab # [ 136.554073] bundle[2018]: {"timestamp":"2026-09-04T07:26:38.416Z","pid":2018,"message":"* Min threads: 0"}1058gitlab # [ 136.558108] bundle[2018]: {"timestamp":"2026-09-04T07:26:38.416Z","pid":2018,"message":"* Max threads: 4"}1059gitlab # [ 136.562070] bundle[2018]: {"timestamp":"2026-09-04T07:26:38.416Z","pid":2018,"message":"* Environment: production"}1060gitlab # [ 136.566417] bundle[2018]: {"timestamp":"2026-09-04T07:26:38.416Z","pid":2018,"message":"* Master PID: 2018"}1061gitlab # [ 136.570674] bundle[2018]: {"timestamp":"2026-09-04T07:26:38.416Z","pid":2018,"message":"* Workers: 2"}1062gitlab # [ 136.574630] bundle[2018]: {"timestamp":"2026-09-04T07:26:38.416Z","pid":2018,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1063gitlab # [ 136.579683] bundle[2018]: {"timestamp":"2026-09-04T07:26:38.416Z","pid":2018,"message":"* Preloading application"}1064gitlab # [ 140.102062] gitlab-workhorse[816]: time="2026-09-04T07:26:41Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1065gitlab # [ 150.110702] gitlab-workhorse[816]: time="2026-09-04T07:26:51Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1066gitlab # [ 160.130404] gitlab-workhorse[816]: time="2026-09-04T07:27:02Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1067gitlab # [ 170.140685] gitlab-workhorse[816]: time="2026-09-04T07:27:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1068gitlab # [ 180.150857] gitlab-workhorse[816]: time="2026-09-04T07:27:22Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1069gitlab # [ 185.940150] bundle[2018]: W, [2026-09-04T07:27:27.824693 #2018] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1070gitlab # [ 190.158450] gitlab-workhorse[816]: time="2026-09-04T07:27:32Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1071gitlab # [ 192.383821] sidekiq-cluster[2077]: 2026-09-04T07:27:34.268Z pid=2077 tid=xpx INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2077, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>432697344}1072gitlab # [ 193.037849] sidekiq-cluster[2077]: W, [2026-09-04T07:27:34.923719 #2077] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1073gitlab # [ 193.144792] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:35.030Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1074gitlab # [ 198.007197] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:39.891Z","message":"GitLab reliable fetch activated!"}1075gitlab # [ 198.007610] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:39.892Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1076gitlab # [ 198.050507] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:39.936Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1077gitlab # [ 198.058047] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:39.939Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1078gitlab # [ 198.065616] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:39.943Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1079gitlab # [ 198.072528] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:39.947Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1080gitlab # [ 198.080322] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:39.950Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1081gitlab # [ 198.087498] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:39.953Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1082gitlab # [ 198.100720] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:39.956Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1083gitlab # [ 198.107148] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:39.959Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1084gitlab # [ 198.112729] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:39.962Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1085gitlab # [ 198.118168] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:39.965Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1086gitlab # [ 198.125785] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:39.967Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1087gitlab # [ 198.130494] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:39.971Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1088gitlab # [ 198.135225] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:39.975Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1089gitlab # [ 198.139458] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:39.978Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1090gitlab # [ 198.143394] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:39.980Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1091gitlab # [ 198.147283] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:39.983Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1092gitlab # [ 198.151093] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:39.990Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1093gitlab # [ 198.155447] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:39.994Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1094gitlab # [ 198.159735] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:39.997Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1095gitlab # [ 198.163804] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.001Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1096gitlab # [ 198.168225] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.005Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1097gitlab # [ 198.172346] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.008Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1098gitlab # [ 198.175762] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.011Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1099gitlab # [ 198.179294] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.014Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1100gitlab # [ 198.182731] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.017Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1101gitlab # [ 198.185858] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.020Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1102gitlab # [ 198.188715] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.024Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1103gitlab # [ 198.191686] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.027Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1104gitlab # [ 198.194698] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.031Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1105gitlab # [ 198.197762] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.034Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1106gitlab # [ 198.200513] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.037Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1107gitlab # [ 198.203469] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.041Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1108gitlab # [ 198.206297] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.045Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1109gitlab # [ 198.210623] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.048Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1110gitlab # [ 198.213781] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.050Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1111gitlab # [ 198.216913] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.052Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1112gitlab # [ 198.219962] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.055Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1113gitlab # [ 198.222907] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.058Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1114gitlab # [ 198.225769] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.061Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1115gitlab # [ 198.228482] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.063Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1116gitlab # [ 198.231251] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.066Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1117gitlab # [ 198.233889] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.068Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1118gitlab # [ 198.236531] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.071Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1119gitlab # [ 198.239020] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.074Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1120gitlab # [ 198.241647] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.077Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1121gitlab # [ 198.244231] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.079Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1122gitlab # [ 198.246746] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.081Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1123gitlab # [ 198.249274] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.083Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1124gitlab # [ 198.251605] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.086Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1125gitlab # [ 198.254032] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.088Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1126gitlab # [ 198.256335] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.090Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1127gitlab # [ 198.258505] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.093Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1128gitlab # [ 198.260677] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.105Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1129gitlab # [ 198.263019] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.108Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1130gitlab # [ 198.265346] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.111Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1131gitlab # [ 198.267593] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.114Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1132gitlab # [ 198.269891] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.116Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1133gitlab # [ 198.272396] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.119Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1134gitlab # [ 198.274824] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.121Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1135gitlab # [ 198.277341] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.124Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1136gitlab # [ 198.279533] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.126Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1137gitlab # [ 198.281773] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.128Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1138gitlab # [ 198.284083] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.131Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1139gitlab # [ 198.286415] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.134Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1140gitlab # [ 198.288966] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.136Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1141gitlab # [ 198.291361] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.139Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1142gitlab # [ 198.293747] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.141Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1143gitlab # [ 198.296209] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.143Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1144gitlab # [ 198.298691] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.145Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1145gitlab # [ 198.301241] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.147Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1146gitlab # [ 198.303645] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.150Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1147gitlab # [ 198.306104] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.152Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1148gitlab # [ 198.308357] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.154Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1149gitlab # [ 198.310647] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.156Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1150gitlab # [ 198.312971] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.158Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1151gitlab # [ 198.315242] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.160Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1152gitlab # [ 198.317469] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.162Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1153gitlab # [ 198.319880] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.164Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1154gitlab # [ 198.322181] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.166Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1155gitlab # [ 198.324317] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.168Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1156gitlab # [ 198.326602] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.170Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1157gitlab # [ 198.329108] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.173Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1158gitlab # [ 198.331320] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.176Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1159gitlab # [ 198.333562] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.178Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1160gitlab # [ 198.335857] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.181Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1161gitlab # [ 198.338153] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.183Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1162gitlab # [ 198.340486] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.185Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1163gitlab # [ 198.342676] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.187Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1164gitlab # [ 198.345027] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.190Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1165gitlab # [ 198.347284] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.192Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1166gitlab # [ 198.349686] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.194Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1167gitlab # [ 198.351973] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.196Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1168gitlab # [ 198.354406] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.198Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1169gitlab # [ 198.356922] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.200Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1170gitlab # [ 198.358914] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.203Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1171gitlab # [ 198.361368] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.205Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1172gitlab # [ 198.363647] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.208Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1173gitlab # [ 198.366004] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.210Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1174gitlab # [ 198.368237] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.232Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1175gitlab # [ 198.370446] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.235Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1176gitlab # [ 198.372683] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.238Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1177gitlab # [ 198.374970] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.242Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1178gitlab # [ 198.377077] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.245Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1179gitlab # [ 198.379274] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.248Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1180gitlab # [ 198.381726] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.251Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1181gitlab # [ 198.384094] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.254Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1182gitlab # [ 198.386366] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.256Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1183gitlab # [ 198.433047] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.316Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1184gitlab # [ 198.440802] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:27:40.323Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1185gitlab # [ 200.159696] gitlab-workhorse[816]: time="2026-09-04T07:27:42Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1186gitlab # [ 210.166700] gitlab-workhorse[816]: time="2026-09-04T07:27:52Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1187gitlab # [ 220.168223] gitlab-workhorse[816]: time="2026-09-04T07:28:02Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1188gitlab # [ 230.177355] gitlab-workhorse[816]: time="2026-09-04T07:28:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1189gitlab # [ 240.186366] gitlab-workhorse[816]: time="2026-09-04T07:28:22Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1190gitlab # [ 250.147392] postgres[3022]: [3022] ERROR: relation "table_without_models" does not exist1191gitlab # [ 250.147989] postgres[3022]: [3022] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1192gitlab # [ 250.190084] gitlab-workhorse[816]: time="2026-09-04T07:28:32Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1193gitlab # [ 251.946354] postgres[3033]: [3033] ERROR: relation "table_without_models" does not exist1194gitlab # [ 251.950114] postgres[3033]: [3033] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1195gitlab # [ 255.716350] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:37.601Z","message":"Booted Rails 7.2.3.1 application in production environment"}1196gitlab # [ 255.718480] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:37.602Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1197gitlab # [ 255.720961] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:37.602Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1198gitlab # [ 255.723232] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:37.602Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1199gitlab # [ 255.725551] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:37.608Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1200gitlab # [ 258.546566] bundle[2018]: {"timestamp":"2026-09-04T07:28:40.431Z","pid":2018,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1201gitlab # [ 258.552595] bundle[2018]: {"timestamp":"2026-09-04T07:28:40.431Z","pid":2018,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1202gitlab # [ 258.558298] bundle[2018]: {"timestamp":"2026-09-04T07:28:40.431Z","pid":2018,"message":"! #\u003cThread:0x0000e50ea757e928 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1203gitlab # [ 258.574838] bundle[2018]: {"timestamp":"2026-09-04T07:28:40.431Z","pid":2018,"message":"! #\u003cThread:0x0000e50ea4d683a8 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1204gitlab # [ 258.591203] bundle[2018]: {"timestamp":"2026-09-04T07:28:40.431Z","pid":2018,"message":"Use Ctrl-C to stop"}1205gitlab # [ 258.595022] bundle[2018]: {"timestamp":"2026-09-04T07:28:40.432Z","pid":2018,"message":"Sending status to systemd every 1.0 sec"}1206gitlab # [ 259.038250] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:40.921Z","message":"Cleaning working queues"}1207gitlab # [ 259.049315] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:40.934Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"39dfe778b3692de3aeca8b91","created_at":"2026-09-04T07:26:31.752Z","trace_propagation_headers":{"sentry-trace":"2d02c9d16e3947bf87f869a6283292d0-8e1f262fbe134d05","baggage":"sentry-trace_id=2d02c9d16e3947bf87f869a6283292d0,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"df776bb3d8ee619b91ae4ad9ec68cf1e","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T07:26:31.766Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-39dfe778b3692de3aeca8b91: start","job_status":"start","queue_duration_s":129.168057,"scheduling_latency_s":129.168196}1208gitlab # [ 259.322679] bundle[2018]: {"timestamp":"2026-09-04T07:28:41.208Z","pid":2018,"message":"- Worker 0 (PID: 3153) booted in 0.71s, phase: 0"}1209gitlab # [ 259.377185] bundle[2018]: {"timestamp":"2026-09-04T07:28:41.263Z","pid":2018,"message":"- Worker 1 (PID: 3157) booted in 0.72s, phase: 0"}1210gitlab # [ 259.384195] systemd[1]: Started gitlab.service.1211gitlab # [ 259.385153] systemd[1]: Reached target Common target for all GitLab services..1212gitlab # [ 259.390937] systemd[1]: Starting setup-gitlab.service...1213gitlab # [ 259.430152] setup-gitlab-start[3195]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1214gitlab # [ 259.456348] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:41.341Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"39dfe778b3692de3aeca8b91","created_at":"2026-09-04T07:26:31.752Z","trace_propagation_headers":{"sentry-trace":"2d02c9d16e3947bf87f869a6283292d0-8e1f262fbe134d05","baggage":"sentry-trace_id=2d02c9d16e3947bf87f869a6283292d0,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"df776bb3d8ee619b91ae4ad9ec68cf1e","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T07:26:31.766Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-39dfe778b3692de3aeca8b91: done: 0.407973 sec","job_status":"done","queue_duration_s":129.168057,"scheduling_latency_s":129.168196,"redis_calls":24,"redis_duration_s":0.009414,"redis_read_bytes":912,"redis_write_bytes":2622,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.005235,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002544,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001635,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.175005,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.21064082,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.407973,"completed_at":"2026-09-04T07:28:41.341Z","load_balancing_strategy":"primary","db_duration_s":0.115945,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1215gitlab # [ 263.553778] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:28:45 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 40621216gitlab # [ 263.560749] setup-gitlab-start[3195]: + TOKEN=nixbot-test-token-of-20-chars1217gitlab # [ 263.561925] setup-gitlab-start[3195]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1218gitlab # [ 263.584280] runuser[3223]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1219gitlab # [ 264.255338] setup-gitlab-start[3224]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1220gitlab # [ 264.255814] setup-gitlab-start[3224]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1221gitlab # [ 264.258017] setup-gitlab-start[3224]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1222gitlab # [ 265.281157] setup-gitlab-start[3224]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1223gitlab # [ 265.281570] setup-gitlab-start[3224]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1224gitlab # [ 265.283712] setup-gitlab-start[3224]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1225gitlab # [ 274.105287] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:55.989Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"51deac892d2299ba21f6ca9d","created_at":"2026-09-04T07:28:55.885Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:55.986Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-51deac892d2299ba21f6ca9d: start","job_status":"start","queue_duration_s":0.002939,"scheduling_latency_s":0.002996}1226gitlab # [ 275.039339] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:56.924Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"51deac892d2299ba21f6ca9d","created_at":"2026-09-04T07:28:55.885Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:55.986Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-51deac892d2299ba21f6ca9d: done: 0.934302 sec","job_status":"done","queue_duration_s":0.002939,"scheduling_latency_s":0.002996,"redis_calls":71,"redis_duration_s":0.348778,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.040315,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.003336,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.297207,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00792,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.378479,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00410416,"duration_s":0.934302,"completed_at":"2026-09-04T07:28:56.923Z","load_balancing_strategy":"primary","db_duration_s":0.044667,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1227gitlab # [ 275.135164] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:56.954Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"8ccf60948d1413ff9cb8d86b","created_at":"2026-09-04T07:28:56.039Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d806cb1bda51afb912ecb6ee3c92dbd3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:28:56.064Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-8ccf60948d1413ff9cb8d86b: start","job_status":"start","queue_duration_s":0.889258,"scheduling_latency_s":0.88932}1228gitlab # [ 275.135349] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:56.991Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1229gitlab # [ 275.135450] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:57.011Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"8ccf60948d1413ff9cb8d86b","created_at":"2026-09-04T07:28:56.039Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d806cb1bda51afb912ecb6ee3c92dbd3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:28:56.064Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-8ccf60948d1413ff9cb8d86b: done: 0.057792 sec","job_status":"done","queue_duration_s":0.889258,"scheduling_latency_s":0.88932,"redis_calls":10,"redis_duration_s":0.00475,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000958,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002739,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001053,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00077774,"duration_s":0.057792,"completed_at":"2026-09-04T07:28:57.011Z","load_balancing_strategy":"primary","db_duration_s":0.001176,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1230gitlab # [ 275.798160] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:57.015Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"4058351e215e462ce0b0f127","created_at":"2026-09-04T07:28:56.087Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"27b08a9153576ca2907e68b80ef00baf","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.104Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-4058351e215e462ce0b0f127: start","job_status":"start","queue_duration_s":0.911044,"scheduling_latency_s":0.91109}1231gitlab # [ 275.798383] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:57.172Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"4058351e215e462ce0b0f127","created_at":"2026-09-04T07:28:56.087Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"27b08a9153576ca2907e68b80ef00baf","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.104Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-4058351e215e462ce0b0f127: done: 0.157397 sec","job_status":"done","queue_duration_s":0.911044,"scheduling_latency_s":0.91109,"redis_calls":13,"redis_duration_s":0.034329,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000569,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.013522,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.020238,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065497,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.04539666,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.157397,"completed_at":"2026-09-04T07:28:57.172Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031442,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1232gitlab # [ 276.503750] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:57.186Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"5a6ff5057c788336736b828e","created_at":"2026-09-04T07:28:56.127Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f08a9f431983af40f194d994c339cb88","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.154Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-5a6ff5057c788336736b828e: start","job_status":"start","queue_duration_s":1.031851,"scheduling_latency_s":1.031923}1233gitlab # [ 276.503884] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:57.712Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"5a6ff5057c788336736b828e","created_at":"2026-09-04T07:28:56.127Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f08a9f431983af40f194d994c339cb88","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.154Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-5a6ff5057c788336736b828e: done: 0.526553 sec","job_status":"done","queue_duration_s":1.031851,"scheduling_latency_s":1.031923,"redis_calls":14,"redis_duration_s":0.025532,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.011769,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009207,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004556,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.07,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.063,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.174527,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00318156,"exclusive_lock_hold_duration_s":0.33485578,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.526553,"completed_at":"2026-09-04T07:28:57.712Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.078349,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1234gitlab # [ 277.188872] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:57.716Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"c4b45fdbde54e77acdf1b0c8","created_at":"2026-09-04T07:28:56.196Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d392d28b54d56c20a15c5217479b16d","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.231Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-c4b45fdbde54e77acdf1b0c8: start","job_status":"start","queue_duration_s":1.484275,"scheduling_latency_s":1.484325}1235gitlab # [ 277.860669] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:57.786Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"c4b45fdbde54e77acdf1b0c8","created_at":"2026-09-04T07:28:56.196Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d392d28b54d56c20a15c5217479b16d","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.231Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-c4b45fdbde54e77acdf1b0c8: done: 0.070881 sec","job_status":"done","queue_duration_s":1.484275,"scheduling_latency_s":1.484325,"redis_calls":10,"redis_duration_s":0.004818,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000984,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002868,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000966,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00095976,"duration_s":0.070881,"completed_at":"2026-09-04T07:28:57.786Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013053,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1236gitlab # [ 278.530095] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:57.790Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9f07016dad5d71dfc99860ca","created_at":"2026-09-04T07:28:56.302Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"be1f9ac595b680f46b005fb57592f799","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.338Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9f07016dad5d71dfc99860ca: start","job_status":"start","queue_duration_s":1.452734,"scheduling_latency_s":1.452782}1237gitlab # [ 278.530233] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:57.842Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9f07016dad5d71dfc99860ca","created_at":"2026-09-04T07:28:56.302Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"be1f9ac595b680f46b005fb57592f799","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.338Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9f07016dad5d71dfc99860ca: done: 0.051509 sec","job_status":"done","queue_duration_s":1.452734,"scheduling_latency_s":1.452782,"redis_calls":12,"redis_duration_s":0.004831,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00181,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002229,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000792,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00054472,"duration_s":0.051509,"completed_at":"2026-09-04T07:28:57.842Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001914,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1238gitlab # [ 279.139571] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:57.845Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"e09be8dfa9e56300cfd030a2","created_at":"2026-09-04T07:28:56.383Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ea083738bfae4307c700257a75885626","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.410Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-e09be8dfa9e56300cfd030a2: start","job_status":"start","queue_duration_s":1.434437,"scheduling_latency_s":1.434476}1239gitlab # [ 279.139706] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:57.927Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"e09be8dfa9e56300cfd030a2","created_at":"2026-09-04T07:28:56.383Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ea083738bfae4307c700257a75885626","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.410Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-e09be8dfa9e56300cfd030a2: done: 0.08226 sec","job_status":"done","queue_duration_s":1.434437,"scheduling_latency_s":1.434476,"redis_calls":16,"redis_duration_s":0.006975,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003287,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002933,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000755,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041961,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00087128,"duration_s":0.08226,"completed_at":"2026-09-04T07:28:57.927Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025602,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1240gitlab # [ 279.865201] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:57.930Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"42498d2f92b9a574a9802b1b","created_at":"2026-09-04T07:28:56.438Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bc67527677201cbac3198ab356afdd6d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.474Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-42498d2f92b9a574a9802b1b: start","job_status":"start","queue_duration_s":1.456025,"scheduling_latency_s":1.45606}1241gitlab # [ 279.865359] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:57.949Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1242gitlab # [ 280.586345] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:57.961Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"42498d2f92b9a574a9802b1b","created_at":"2026-09-04T07:28:56.438Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bc67527677201cbac3198ab356afdd6d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.474Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-42498d2f92b9a574a9802b1b: done: 0.031049 sec","job_status":"done","queue_duration_s":1.456025,"scheduling_latency_s":1.45606,"redis_calls":10,"redis_duration_s":0.003452,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000697,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002112,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000643,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00043698,"duration_s":0.031049,"completed_at":"2026-09-04T07:28:57.961Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000845,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1243gitlab # [ 280.586677] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:57.963Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"6a707d5113f4d36700b7990b","created_at":"2026-09-04T07:28:56.502Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37bc3f8cfe9adeec18e8f92fb466907f","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.535Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-6a707d5113f4d36700b7990b: start","job_status":"start","queue_duration_s":1.428468,"scheduling_latency_s":1.4285}1244gitlab # [ 281.288818] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:58.010Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"6a707d5113f4d36700b7990b","created_at":"2026-09-04T07:28:56.502Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37bc3f8cfe9adeec18e8f92fb466907f","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.535Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-6a707d5113f4d36700b7990b: done: 0.046361 sec","job_status":"done","queue_duration_s":1.428468,"scheduling_latency_s":1.4285,"redis_calls":10,"redis_duration_s":0.003688,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000763,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002136,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000789,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026699,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00056864,"duration_s":0.046361,"completed_at":"2026-09-04T07:28:58.009Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008269,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1245gitlab # [ 281.985738] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:58.012Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"808662a017316f4bb011fae6","created_at":"2026-09-04T07:28:56.584Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c1a96e891012cc23fc0c2069a07bb516","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.618Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-808662a017316f4bb011fae6: start","job_status":"start","queue_duration_s":1.393929,"scheduling_latency_s":1.393985}1246gitlab # [ 281.985877] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:58.084Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"808662a017316f4bb011fae6","created_at":"2026-09-04T07:28:56.584Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c1a96e891012cc23fc0c2069a07bb516","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.618Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-808662a017316f4bb011fae6: done: 0.071872 sec","job_status":"done","queue_duration_s":1.393929,"scheduling_latency_s":1.393985,"redis_calls":10,"redis_duration_s":0.003451,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000715,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002001,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000735,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026769,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00072348,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.071872,"completed_at":"2026-09-04T07:28:58.084Z","load_balancing_strategy":"primary","db_duration_s":0.032861,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1247gitlab # [ 282.596853] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:58.086Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"137d086042915486099000a2","created_at":"2026-09-04T07:28:56.645Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e76208874250fa6d5cac3a68f80db8f8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.674Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-137d086042915486099000a2: start","job_status":"start","queue_duration_s":1.411671,"scheduling_latency_s":1.411709}1248gitlab # [ 282.597043] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:58.558Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"137d086042915486099000a2","created_at":"2026-09-04T07:28:56.645Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e76208874250fa6d5cac3a68f80db8f8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.674Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-137d086042915486099000a2: done: 0.471739 sec","job_status":"done","queue_duration_s":1.411671,"scheduling_latency_s":1.411709,"redis_calls":14,"redis_duration_s":0.005775,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001819,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001987,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001969,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.07,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.07,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.37773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00093504,"exclusive_lock_hold_duration_s":0.42429948,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.471739,"completed_at":"2026-09-04T07:28:58.558Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.108704,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1249gitlab # [ 283.271676] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:58.561Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"a764eb96c9c2da10af155fe3","created_at":"2026-09-04T07:28:56.723Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d668ee8f4572892b2c87a6416830cd78","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.754Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-a764eb96c9c2da10af155fe3: start","job_status":"start","queue_duration_s":1.807099,"scheduling_latency_s":1.807145}1250gitlab # [ 283.993981] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:58.612Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"a764eb96c9c2da10af155fe3","created_at":"2026-09-04T07:28:56.723Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d668ee8f4572892b2c87a6416830cd78","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.754Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-a764eb96c9c2da10af155fe3: done: 0.050733 sec","job_status":"done","queue_duration_s":1.807099,"scheduling_latency_s":1.807145,"redis_calls":12,"redis_duration_s":0.004992,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00092,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002176,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001896,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00110688,"exclusive_lock_hold_duration_s":0.00783724,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.050733,"completed_at":"2026-09-04T07:28:58.612Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00382,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1251gitlab # [ 284.668187] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:58.614Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"9df300567feed8b6c5ec8544","created_at":"2026-09-04T07:28:56.785Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b7f960337944c8fcea83b63e8ec7b3d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.819Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-9df300567feed8b6c5ec8544: start","job_status":"start","queue_duration_s":1.795463,"scheduling_latency_s":1.795501}1252gitlab # [ 284.713436] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:58.652Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"9df300567feed8b6c5ec8544","created_at":"2026-09-04T07:28:56.785Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b7f960337944c8fcea83b63e8ec7b3d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.819Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-9df300567feed8b6c5ec8544: done: 0.037591 sec","job_status":"done","queue_duration_s":1.795463,"scheduling_latency_s":1.795501,"redis_calls":10,"redis_duration_s":0.003408,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000746,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001961,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000701,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02264,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00047412,"duration_s":0.037591,"completed_at":"2026-09-04T07:28:58.652Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001067,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1253gitlab # [ 284.795159] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:58.654Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b0071e7246938c88ab88c06","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b0071e7246938c88ab88c06: start","job_status":"start","queue_duration_s":1.782798,"scheduling_latency_s":1.782836}1254gitlab # [ 284.813497] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:58.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b0071e7246938c88ab88c06","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b0071e7246938c88ab88c06: done: 0.041497 sec","job_status":"done","queue_duration_s":1.782798,"scheduling_latency_s":1.782836,"redis_calls":16,"redis_duration_s":0.006778,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000924,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002109,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003745,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004645,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.041497,"completed_at":"2026-09-04T07:28:58.696Z","load_balancing_strategy":"primary","db_duration_s":0.000996,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1255gitlab # [ 284.865232] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:58.698Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3dc2ffb19fc4ef11f5900ea4","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3dc2ffb19fc4ef11f5900ea4: start","job_status":"start","queue_duration_s":1.826149,"scheduling_latency_s":1.826178}1256gitlab # [ 284.878323] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:58.717Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3dc2ffb19fc4ef11f5900ea4","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3dc2ffb19fc4ef11f5900ea4: done: 0.019173 sec","job_status":"done","queue_duration_s":1.826149,"scheduling_latency_s":1.826178,"redis_calls":13,"redis_duration_s":0.002909,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000973,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011526,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019173,"completed_at":"2026-09-04T07:28:58.717Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1257gitlab # [ 284.918663] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:58.718Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a822b566d1461306ac3d626c","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a822b566d1461306ac3d626c: start","job_status":"start","queue_duration_s":1.846843,"scheduling_latency_s":1.846866}1258gitlab # [ 284.931315] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:58.736Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a822b566d1461306ac3d626c","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a822b566d1461306ac3d626c: done: 0.018092 sec","job_status":"done","queue_duration_s":1.846843,"scheduling_latency_s":1.846866,"redis_calls":13,"redis_duration_s":0.002793,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000995,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001798,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018092,"completed_at":"2026-09-04T07:28:58.736Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1259gitlab # [ 284.972136] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:58.738Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e48a117bda537b5140ee9f25","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e48a117bda537b5140ee9f25: start","job_status":"start","queue_duration_s":1.866622,"scheduling_latency_s":1.866644}1260gitlab # [ 284.984811] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:58.757Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e48a117bda537b5140ee9f25","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e48a117bda537b5140ee9f25: done: 0.018877 sec","job_status":"done","queue_duration_s":1.866622,"scheduling_latency_s":1.866644,"redis_calls":13,"redis_duration_s":0.003102,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00205,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011471,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018877,"completed_at":"2026-09-04T07:28:58.757Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1261gitlab # [ 285.026523] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:58.759Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a099c7fa354b33225b93171a","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a099c7fa354b33225b93171a: start","job_status":"start","queue_duration_s":1.887235,"scheduling_latency_s":1.887257}1262gitlab # [ 285.039405] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:58.785Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a099c7fa354b33225b93171a","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a099c7fa354b33225b93171a: done: 0.026286 sec","job_status":"done","queue_duration_s":1.887235,"scheduling_latency_s":1.887257,"redis_calls":13,"redis_duration_s":0.00378,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002247,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015794,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026286,"completed_at":"2026-09-04T07:28:58.785Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1263gitlab # [ 285.079711] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:58.789Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b56d4c7c9aacefef3f64a9e","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b56d4c7c9aacefef3f64a9e: start","job_status":"start","queue_duration_s":1.917257,"scheduling_latency_s":1.917306}1264gitlab # [ 285.092821] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:58.834Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b56d4c7c9aacefef3f64a9e","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b56d4c7c9aacefef3f64a9e: done: 0.045027 sec","job_status":"done","queue_duration_s":1.917257,"scheduling_latency_s":1.917306,"redis_calls":13,"redis_duration_s":0.004213,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00267,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030882,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.045027,"completed_at":"2026-09-04T07:28:58.834Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1265gitlab # [ 285.133278] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:58.837Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70c07898c66ce8e426811ed7","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70c07898c66ce8e426811ed7: start","job_status":"start","queue_duration_s":1.965577,"scheduling_latency_s":1.96562}1266gitlab # [ 285.146222] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:58.876Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70c07898c66ce8e426811ed7","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70c07898c66ce8e426811ed7: done: 0.038648 sec","job_status":"done","queue_duration_s":1.965577,"scheduling_latency_s":1.96562,"redis_calls":13,"redis_duration_s":0.005169999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002224,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002946,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038648,"completed_at":"2026-09-04T07:28:58.876Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1267gitlab # [ 285.186971] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:58.880Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a3313228e77664db46bc87a","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a3313228e77664db46bc87a: start","job_status":"start","queue_duration_s":2.008324,"scheduling_latency_s":2.008372}1268gitlab # [ 285.200485] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:58.930Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a3313228e77664db46bc87a","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a3313228e77664db46bc87a: done: 0.0498 sec","job_status":"done","queue_duration_s":2.008324,"scheduling_latency_s":2.008372,"redis_calls":13,"redis_duration_s":0.013221,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0078,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005421,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026684,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0498,"completed_at":"2026-09-04T07:28:58.929Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1269gitlab # [ 285.245230] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:58.932Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3cd6d71f75af6efd3d0e34bd","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3cd6d71f75af6efd3d0e34bd: start","job_status":"start","queue_duration_s":2.060871,"scheduling_latency_s":2.060912}1270gitlab # [ 285.259399] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:58.966Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3cd6d71f75af6efd3d0e34bd","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3cd6d71f75af6efd3d0e34bd: done: 0.03394 sec","job_status":"done","queue_duration_s":2.060871,"scheduling_latency_s":2.060912,"redis_calls":13,"redis_duration_s":0.004158,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001479,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002679,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021631,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03394,"completed_at":"2026-09-04T07:28:58.966Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1271gitlab # [ 285.300150] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:58.969Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94f533d6447909320711955b","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94f533d6447909320711955b: start","job_status":"start","queue_duration_s":2.097153,"scheduling_latency_s":2.097191}1272gitlab # [ 285.312329] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94f533d6447909320711955b","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94f533d6447909320711955b: done: 0.032394 sec","job_status":"done","queue_duration_s":2.097153,"scheduling_latency_s":2.097191,"redis_calls":13,"redis_duration_s":0.00316,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001211,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001949,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032394,"completed_at":"2026-09-04T07:28:59.001Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1273gitlab # [ 285.352103] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.004Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7abec04c575045f05229d882","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7abec04c575045f05229d882: start","job_status":"start","queue_duration_s":2.132221,"scheduling_latency_s":2.132262}1274gitlab # [ 285.364634] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.032Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7abec04c575045f05229d882","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7abec04c575045f05229d882: done: 0.028456 sec","job_status":"done","queue_duration_s":2.132221,"scheduling_latency_s":2.132262,"redis_calls":13,"redis_duration_s":0.002768,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001675,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018413,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028456,"completed_at":"2026-09-04T07:28:59.032Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1275gitlab # [ 285.404383] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.035Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"991a47b34b65fb5c51e69ab7","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-991a47b34b65fb5c51e69ab7: start","job_status":"start","queue_duration_s":2.162956,"scheduling_latency_s":2.162991}1276gitlab # [ 285.417013] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.061Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"991a47b34b65fb5c51e69ab7","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-991a47b34b65fb5c51e69ab7: done: 0.027029 sec","job_status":"done","queue_duration_s":2.162956,"scheduling_latency_s":2.162991,"redis_calls":13,"redis_duration_s":0.002896,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00106,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001836,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018771,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027029,"completed_at":"2026-09-04T07:28:59.061Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1277gitlab # [ 285.459517] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6af6cd665e7de13336a424b","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6af6cd665e7de13336a424b: start","job_status":"start","queue_duration_s":2.19178,"scheduling_latency_s":2.191809}1278gitlab # [ 285.472336] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.082Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6af6cd665e7de13336a424b","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6af6cd665e7de13336a424b: done: 0.018589 sec","job_status":"done","queue_duration_s":2.19178,"scheduling_latency_s":2.191809,"redis_calls":13,"redis_duration_s":0.00225,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000674,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001576,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018589,"completed_at":"2026-09-04T07:28:59.082Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1279gitlab # [ 285.512295] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.084Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"007c47cebf65d627ad9fcc20","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-007c47cebf65d627ad9fcc20: start","job_status":"start","queue_duration_s":2.212095,"scheduling_latency_s":2.212117}1280gitlab # [ 285.524986] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"007c47cebf65d627ad9fcc20","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-007c47cebf65d627ad9fcc20: done: 0.022609 sec","job_status":"done","queue_duration_s":2.212095,"scheduling_latency_s":2.212117,"redis_calls":13,"redis_duration_s":0.005891,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003694,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002197,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012633,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022609,"completed_at":"2026-09-04T07:28:59.106Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1281gitlab # [ 285.564655] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.108Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"592a43b06327154303ee260e","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-592a43b06327154303ee260e: start","job_status":"start","queue_duration_s":2.236641,"scheduling_latency_s":2.236665}1282gitlab # [ 285.577364] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.131Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"592a43b06327154303ee260e","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-592a43b06327154303ee260e: done: 0.022702 sec","job_status":"done","queue_duration_s":2.236641,"scheduling_latency_s":2.236665,"redis_calls":13,"redis_duration_s":0.0028989999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001323,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001576,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022702,"completed_at":"2026-09-04T07:28:59.131Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1283gitlab # [ 285.617274] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.133Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"865c90ace76832820bb4e1ad","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-865c90ace76832820bb4e1ad: start","job_status":"start","queue_duration_s":2.261535,"scheduling_latency_s":2.261562}1284gitlab # [ 285.631281] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.158Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"865c90ace76832820bb4e1ad","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-865c90ace76832820bb4e1ad: done: 0.02525 sec","job_status":"done","queue_duration_s":2.261535,"scheduling_latency_s":2.261562,"redis_calls":13,"redis_duration_s":0.002859,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000859,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017127,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02525,"completed_at":"2026-09-04T07:28:59.158Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1285gitlab # [ 285.671891] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.160Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ad21ac99ab1c71ce6b6792e","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ad21ac99ab1c71ce6b6792e: start","job_status":"start","queue_duration_s":2.28885,"scheduling_latency_s":2.288877}1286gitlab # [ 285.684911] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.187Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ad21ac99ab1c71ce6b6792e","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ad21ac99ab1c71ce6b6792e: done: 0.026171 sec","job_status":"done","queue_duration_s":2.28885,"scheduling_latency_s":2.288877,"redis_calls":13,"redis_duration_s":0.003759,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002703,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017087,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026171,"completed_at":"2026-09-04T07:28:59.186Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1287gitlab # [ 285.725008] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.189Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68f081e6977e7e2b6f377645","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68f081e6977e7e2b6f377645: start","job_status":"start","queue_duration_s":2.317384,"scheduling_latency_s":2.317411}1288gitlab # [ 285.737635] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.214Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68f081e6977e7e2b6f377645","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68f081e6977e7e2b6f377645: done: 0.025472 sec","job_status":"done","queue_duration_s":2.317384,"scheduling_latency_s":2.317411,"redis_calls":13,"redis_duration_s":0.0035399999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001198,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002342,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01591,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025472,"completed_at":"2026-09-04T07:28:59.214Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1289gitlab # [ 285.777607] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.216Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b80bac125a89f23bcd051142","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b80bac125a89f23bcd051142: start","job_status":"start","queue_duration_s":2.344806,"scheduling_latency_s":2.344834}1290gitlab # [ 285.790016] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b80bac125a89f23bcd051142","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b80bac125a89f23bcd051142: done: 0.026009 sec","job_status":"done","queue_duration_s":2.344806,"scheduling_latency_s":2.344834,"redis_calls":13,"redis_duration_s":0.003687,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001229,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002458,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016388,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026009,"completed_at":"2026-09-04T07:28:59.242Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1291gitlab # [ 285.830948] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.244Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42413381135a3058d6e72027","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42413381135a3058d6e72027: start","job_status":"start","queue_duration_s":2.372852,"scheduling_latency_s":2.372882}1292gitlab # [ 285.846898] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.270Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42413381135a3058d6e72027","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42413381135a3058d6e72027: done: 0.02561 sec","job_status":"done","queue_duration_s":2.372852,"scheduling_latency_s":2.372882,"redis_calls":13,"redis_duration_s":0.0033819999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001187,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002195,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015817,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02561,"completed_at":"2026-09-04T07:28:59.270Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1293gitlab # [ 285.893223] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f7213f6db4e765ac57d9ee2","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f7213f6db4e765ac57d9ee2: start","job_status":"start","queue_duration_s":2.400686,"scheduling_latency_s":2.400718}1294gitlab # [ 285.907723] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f7213f6db4e765ac57d9ee2","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f7213f6db4e765ac57d9ee2: done: 0.027398 sec","job_status":"done","queue_duration_s":2.400686,"scheduling_latency_s":2.400718,"redis_calls":13,"redis_duration_s":0.003654,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001208,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002446,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027398,"completed_at":"2026-09-04T07:28:59.299Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1295gitlab # [ 285.952865] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.301Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54bf2acfdfe5076e482575f8","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54bf2acfdfe5076e482575f8: start","job_status":"start","queue_duration_s":2.429728,"scheduling_latency_s":2.429756}1296gitlab # [ 285.967305] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.326Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54bf2acfdfe5076e482575f8","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54bf2acfdfe5076e482575f8: done: 0.024932 sec","job_status":"done","queue_duration_s":2.429728,"scheduling_latency_s":2.429756,"redis_calls":13,"redis_duration_s":0.003536,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001186,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00235,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015597,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024932,"completed_at":"2026-09-04T07:28:59.326Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1297gitlab # [ 286.012394] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.328Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a3c9c48a2d78d06fc4b0765","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a3c9c48a2d78d06fc4b0765: start","job_status":"start","queue_duration_s":2.456604,"scheduling_latency_s":2.456633}1298gitlab # [ 286.024892] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a3c9c48a2d78d06fc4b0765","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a3c9c48a2d78d06fc4b0765: done: 0.019751 sec","job_status":"done","queue_duration_s":2.456604,"scheduling_latency_s":2.456633,"redis_calls":13,"redis_duration_s":0.0029960000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001018,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001978,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0115,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019751,"completed_at":"2026-09-04T07:28:59.348Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1299gitlab # [ 286.070750] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.350Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ceec6a8d8f51576f046edac","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ceec6a8d8f51576f046edac: start","job_status":"start","queue_duration_s":2.478133,"scheduling_latency_s":2.478156}1300gitlab # [ 286.085558] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.369Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ceec6a8d8f51576f046edac","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ceec6a8d8f51576f046edac: done: 0.01925 sec","job_status":"done","queue_duration_s":2.478133,"scheduling_latency_s":2.478156,"redis_calls":13,"redis_duration_s":0.003012,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001025,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001987,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011721,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01925,"completed_at":"2026-09-04T07:28:59.369Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1301gitlab # [ 286.131747] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.371Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d7b181c3a615de980433c62","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d7b181c3a615de980433c62: start","job_status":"start","queue_duration_s":2.499297,"scheduling_latency_s":2.49932}1302gitlab # [ 286.146641] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.390Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d7b181c3a615de980433c62","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d7b181c3a615de980433c62: done: 0.019604 sec","job_status":"done","queue_duration_s":2.499297,"scheduling_latency_s":2.49932,"redis_calls":13,"redis_duration_s":0.003343,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001111,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002232,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012133,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019604,"completed_at":"2026-09-04T07:28:59.390Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1303gitlab # [ 286.191863] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.392Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3bc9d77ffaed246d7d196627","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3bc9d77ffaed246d7d196627: start","job_status":"start","queue_duration_s":2.520899,"scheduling_latency_s":2.520923}1304gitlab # [ 286.206788] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.412Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3bc9d77ffaed246d7d196627","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3bc9d77ffaed246d7d196627: done: 0.020051 sec","job_status":"done","queue_duration_s":2.520899,"scheduling_latency_s":2.520923,"redis_calls":13,"redis_duration_s":0.003311,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001118,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002193,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020051,"completed_at":"2026-09-04T07:28:59.412Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1305gitlab # [ 286.253553] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.415Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e8262d5d8212a98288f62e8","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e8262d5d8212a98288f62e8: start","job_status":"start","queue_duration_s":2.543094,"scheduling_latency_s":2.543122}1306gitlab # [ 286.266587] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.435Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e8262d5d8212a98288f62e8","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e8262d5d8212a98288f62e8: done: 0.020479 sec","job_status":"done","queue_duration_s":2.543094,"scheduling_latency_s":2.543122,"redis_calls":13,"redis_duration_s":0.0032069999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001099,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002108,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012641,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020479,"completed_at":"2026-09-04T07:28:59.435Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1307gitlab # [ 286.309898] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.437Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9403d01c81caeb483da53e79","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9403d01c81caeb483da53e79: start","job_status":"start","queue_duration_s":2.565627,"scheduling_latency_s":2.565654}1308gitlab # [ 286.323404] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.462Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9403d01c81caeb483da53e79","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9403d01c81caeb483da53e79: done: 0.024537 sec","job_status":"done","queue_duration_s":2.565627,"scheduling_latency_s":2.565654,"redis_calls":13,"redis_duration_s":0.003477,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001314,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002163,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024537,"completed_at":"2026-09-04T07:28:59.462Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1309gitlab # [ 286.366729] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.465Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4479d1f6ad81950c9be8c6da","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4479d1f6ad81950c9be8c6da: start","job_status":"start","queue_duration_s":2.593869,"scheduling_latency_s":2.593922}1310gitlab # [ 286.380379] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.512Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4479d1f6ad81950c9be8c6da","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4479d1f6ad81950c9be8c6da: done: 0.046479 sec","job_status":"done","queue_duration_s":2.593869,"scheduling_latency_s":2.593922,"redis_calls":13,"redis_duration_s":0.004868,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00153,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003338,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032264,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.046479,"completed_at":"2026-09-04T07:28:59.512Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1311gitlab # [ 286.422371] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.515Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3712d01f5a601232360fa00","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3712d01f5a601232360fa00: start","job_status":"start","queue_duration_s":2.6435,"scheduling_latency_s":2.643552}1312gitlab # [ 286.435565] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.553Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3712d01f5a601232360fa00","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3712d01f5a601232360fa00: done: 0.037649 sec","job_status":"done","queue_duration_s":2.6435,"scheduling_latency_s":2.643552,"redis_calls":13,"redis_duration_s":0.0046040000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024105,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.037649,"completed_at":"2026-09-04T07:28:59.552Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1313gitlab # [ 286.479331] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.555Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22181bafd4c2ce8d29c4b52c","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22181bafd4c2ce8d29c4b52c: start","job_status":"start","queue_duration_s":2.68377,"scheduling_latency_s":2.683805}1314gitlab # [ 286.492608] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.581Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22181bafd4c2ce8d29c4b52c","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22181bafd4c2ce8d29c4b52c: done: 0.025682 sec","job_status":"done","queue_duration_s":2.68377,"scheduling_latency_s":2.683805,"redis_calls":13,"redis_duration_s":0.003394,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001147,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002247,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016018,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025682,"completed_at":"2026-09-04T07:28:59.581Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1315gitlab # [ 286.535194] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"223d3cd740828ebaf7a3ceec","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-223d3cd740828ebaf7a3ceec: start","job_status":"start","queue_duration_s":2.711346,"scheduling_latency_s":2.711373}1316gitlab # [ 286.548915] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.604Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"223d3cd740828ebaf7a3ceec","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-223d3cd740828ebaf7a3ceec: done: 0.020973 sec","job_status":"done","queue_duration_s":2.711346,"scheduling_latency_s":2.711373,"redis_calls":13,"redis_duration_s":0.003172,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001121,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002051,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01311,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020973,"completed_at":"2026-09-04T07:28:59.604Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1317gitlab # [ 286.591578] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d37ff076008dab1cf513dfa","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d37ff076008dab1cf513dfa: start","job_status":"start","queue_duration_s":2.734141,"scheduling_latency_s":2.734166}1318gitlab # [ 286.605368] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.626Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d37ff076008dab1cf513dfa","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d37ff076008dab1cf513dfa: done: 0.020189 sec","job_status":"done","queue_duration_s":2.734141,"scheduling_latency_s":2.734166,"redis_calls":13,"redis_duration_s":0.003434,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001324,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00211,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020189,"completed_at":"2026-09-04T07:28:59.626Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1319gitlab # [ 286.648023] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.628Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"416ccff9687c7851987cc447","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-416ccff9687c7851987cc447: start","job_status":"start","queue_duration_s":2.756327,"scheduling_latency_s":2.756567}1320gitlab # [ 286.662574] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.648Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"416ccff9687c7851987cc447","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-416ccff9687c7851987cc447: done: 0.020465 sec","job_status":"done","queue_duration_s":2.756327,"scheduling_latency_s":2.756567,"redis_calls":13,"redis_duration_s":0.003633,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001136,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002497,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020465,"completed_at":"2026-09-04T07:28:59.648Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321gitlab # [ 286.706112] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.651Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"263af296c20a7ce90f40ddbf","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-263af296c20a7ce90f40ddbf: start","job_status":"start","queue_duration_s":2.779191,"scheduling_latency_s":2.779217}1322gitlab # [ 286.719550] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"263af296c20a7ce90f40ddbf","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-263af296c20a7ce90f40ddbf: done: 0.020077 sec","job_status":"done","queue_duration_s":2.779191,"scheduling_latency_s":2.779217,"redis_calls":13,"redis_duration_s":0.003391,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001138,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002253,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020077,"completed_at":"2026-09-04T07:28:59.671Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323gitlab # [ 286.761791] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.673Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77013744749a8d9764d4de6b","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77013744749a8d9764d4de6b: start","job_status":"start","queue_duration_s":2.80134,"scheduling_latency_s":2.801365}1324gitlab # [ 286.775495] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.694Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77013744749a8d9764d4de6b","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77013744749a8d9764d4de6b: done: 0.020867 sec","job_status":"done","queue_duration_s":2.80134,"scheduling_latency_s":2.801365,"redis_calls":13,"redis_duration_s":0.0040490000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001195,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002854,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020867,"completed_at":"2026-09-04T07:28:59.694Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1325gitlab # [ 286.818518] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51bc53e09bf81c0045af3bd3","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51bc53e09bf81c0045af3bd3: start","job_status":"start","queue_duration_s":2.82427,"scheduling_latency_s":2.824296}1326gitlab # [ 286.832066] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51bc53e09bf81c0045af3bd3","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51bc53e09bf81c0045af3bd3: done: 0.045405 sec","job_status":"done","queue_duration_s":2.82427,"scheduling_latency_s":2.824296,"redis_calls":13,"redis_duration_s":0.004984,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001884,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0031,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033604,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.045405,"completed_at":"2026-09-04T07:28:59.741Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1327gitlab # [ 286.875702] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.745Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"923960c595f89d48a5a60014","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-923960c595f89d48a5a60014: start","job_status":"start","queue_duration_s":2.873448,"scheduling_latency_s":2.873502}1328gitlab # [ 286.888827] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.785Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"923960c595f89d48a5a60014","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-923960c595f89d48a5a60014: done: 0.039613 sec","job_status":"done","queue_duration_s":2.873448,"scheduling_latency_s":2.873502,"redis_calls":13,"redis_duration_s":0.003772,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001266,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002506,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027164,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.039613,"completed_at":"2026-09-04T07:28:59.784Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1329gitlab # [ 286.929642] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.788Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0638cac98e922ec21af7f015","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0638cac98e922ec21af7f015: start","job_status":"start","queue_duration_s":2.916414,"scheduling_latency_s":2.916465}1330gitlab # [ 286.942701] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.822Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0638cac98e922ec21af7f015","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0638cac98e922ec21af7f015: done: 0.034413 sec","job_status":"done","queue_duration_s":2.916414,"scheduling_latency_s":2.916465,"redis_calls":13,"redis_duration_s":0.0037479999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00121,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002538,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022457,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034413,"completed_at":"2026-09-04T07:28:59.822Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1331gitlab # [ 286.983473] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.825Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3a943cebb38d48548e97e81","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3a943cebb38d48548e97e81: start","job_status":"start","queue_duration_s":2.952991,"scheduling_latency_s":2.95303}1332gitlab # [ 286.996634] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.850Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3a943cebb38d48548e97e81","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3a943cebb38d48548e97e81: done: 0.025329 sec","job_status":"done","queue_duration_s":2.952991,"scheduling_latency_s":2.95303,"redis_calls":13,"redis_duration_s":0.003405,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00116,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002245,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025329,"completed_at":"2026-09-04T07:28:59.850Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1333gitlab # [ 287.037679] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.852Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac53eae65f3ca65052251061","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac53eae65f3ca65052251061: start","job_status":"start","queue_duration_s":2.9803,"scheduling_latency_s":2.980332}1334gitlab # [ 287.050455] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.873Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac53eae65f3ca65052251061","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac53eae65f3ca65052251061: done: 0.02137 sec","job_status":"done","queue_duration_s":2.9803,"scheduling_latency_s":2.980332,"redis_calls":13,"redis_duration_s":0.003128,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001065,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002063,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02137,"completed_at":"2026-09-04T07:28:59.873Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335gitlab # [ 287.092711] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.875Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b3308d9ba1a651661041fdda","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b3308d9ba1a651661041fdda: start","job_status":"start","queue_duration_s":3.003496,"scheduling_latency_s":3.003527}1336gitlab # [ 287.105438] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.895Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b3308d9ba1a651661041fdda","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b3308d9ba1a651661041fdda: done: 0.020449 sec","job_status":"done","queue_duration_s":3.003496,"scheduling_latency_s":3.003527,"redis_calls":13,"redis_duration_s":0.003385,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001124,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002261,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012239,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020449,"completed_at":"2026-09-04T07:28:59.895Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337gitlab # [ 287.146626] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80b713757aac14a21c7c5c60","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80b713757aac14a21c7c5c60: start","job_status":"start","queue_duration_s":3.025761,"scheduling_latency_s":3.025792}1338gitlab # [ 287.159903] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80b713757aac14a21c7c5c60","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80b713757aac14a21c7c5c60: done: 0.020139 sec","job_status":"done","queue_duration_s":3.025761,"scheduling_latency_s":3.025792,"redis_calls":13,"redis_duration_s":0.003478,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001278,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012089,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020139,"completed_at":"2026-09-04T07:28:59.917Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339gitlab # [ 287.201005] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.920Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee43dfb7b4f8881bec24af5f","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee43dfb7b4f8881bec24af5f: start","job_status":"start","queue_duration_s":3.048144,"scheduling_latency_s":3.048177}1340gitlab # [ 287.213874] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.940Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee43dfb7b4f8881bec24af5f","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee43dfb7b4f8881bec24af5f: done: 0.019906 sec","job_status":"done","queue_duration_s":3.048144,"scheduling_latency_s":3.048177,"redis_calls":13,"redis_duration_s":0.003095,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001084,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012168,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019906,"completed_at":"2026-09-04T07:28:59.939Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 287.255356] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.942Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8d685c3ccd7bb910dd9c4de","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8d685c3ccd7bb910dd9c4de: start","job_status":"start","queue_duration_s":3.070129,"scheduling_latency_s":3.070164}1342gitlab # [ 287.269717] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8d685c3ccd7bb910dd9c4de","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8d685c3ccd7bb910dd9c4de: done: 0.020215 sec","job_status":"done","queue_duration_s":3.070129,"scheduling_latency_s":3.070164,"redis_calls":13,"redis_duration_s":0.003253,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001088,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002165,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012552,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020215,"completed_at":"2026-09-04T07:28:59.962Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 287.312136] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.964Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"548552dfd2882bdd561a66af","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-548552dfd2882bdd561a66af: start","job_status":"start","queue_duration_s":3.092461,"scheduling_latency_s":3.092512}1344gitlab # [ 287.325439] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.984Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"548552dfd2882bdd561a66af","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-548552dfd2882bdd561a66af: done: 0.02024 sec","job_status":"done","queue_duration_s":3.092461,"scheduling_latency_s":3.092512,"redis_calls":13,"redis_duration_s":0.003257,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00112,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002137,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02024,"completed_at":"2026-09-04T07:28:59.984Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345gitlab # [ 287.365760] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:28:59.987Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"943f8d2b016bfcd08c687750","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-943f8d2b016bfcd08c687750: start","job_status":"start","queue_duration_s":3.114941,"scheduling_latency_s":3.114975}1346gitlab # [ 287.378334] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.007Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"943f8d2b016bfcd08c687750","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-943f8d2b016bfcd08c687750: done: 0.020452 sec","job_status":"done","queue_duration_s":3.114941,"scheduling_latency_s":3.114975,"redis_calls":13,"redis_duration_s":0.003209,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001104,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020452,"completed_at":"2026-09-04T07:29:00.007Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 287.417521] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.009Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f63d02172d3d4be381820b7","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f63d02172d3d4be381820b7: start","job_status":"start","queue_duration_s":3.13747,"scheduling_latency_s":3.137503}1348gitlab # [ 287.430061] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.030Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f63d02172d3d4be381820b7","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f63d02172d3d4be381820b7: done: 0.020578 sec","job_status":"done","queue_duration_s":3.13747,"scheduling_latency_s":3.137503,"redis_calls":13,"redis_duration_s":0.003409,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001349,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00206,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012892,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020578,"completed_at":"2026-09-04T07:29:00.029Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 287.470287] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.032Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6bdea63e03d97047d364710e","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6bdea63e03d97047d364710e: start","job_status":"start","queue_duration_s":3.159952,"scheduling_latency_s":3.159983}1350gitlab # [ 287.482732] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6bdea63e03d97047d364710e","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6bdea63e03d97047d364710e: done: 0.031342 sec","job_status":"done","queue_duration_s":3.159952,"scheduling_latency_s":3.159983,"redis_calls":13,"redis_duration_s":0.004635,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001835,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031342,"completed_at":"2026-09-04T07:29:00.063Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 287.522808] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.067Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e063662228b1989385ee4e9","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e063662228b1989385ee4e9: start","job_status":"start","queue_duration_s":3.19563,"scheduling_latency_s":3.195692}1352gitlab # [ 287.536064] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.116Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e063662228b1989385ee4e9","created_at":"2026-09-04T07:28:56.211Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-3a3515b3b0e1482c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1226b29e1bdaa431faa91b33f589ef19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.872Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e063662228b1989385ee4e9: done: 0.048513 sec","job_status":"done","queue_duration_s":3.19563,"scheduling_latency_s":3.195692,"redis_calls":13,"redis_duration_s":0.0059889999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001821,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004168,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.048513,"completed_at":"2026-09-04T07:29:00.115Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 287.577447] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.119Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"2225f191bc4784ec051d1934","created_at":"2026-09-04T07:28:56.876Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da0311146d5b6184c35b1c7ff5f618c2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.914Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-2225f191bc4784ec051d1934: start","job_status":"start","queue_duration_s":3.204816,"scheduling_latency_s":3.204864}1354gitlab # [ 287.592332] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.141Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1355gitlab # [ 287.595636] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.154Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"2225f191bc4784ec051d1934","created_at":"2026-09-04T07:28:56.876Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da0311146d5b6184c35b1c7ff5f618c2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:56.914Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-2225f191bc4784ec051d1934: done: 0.035434 sec","job_status":"done","queue_duration_s":3.204816,"scheduling_latency_s":3.204864,"redis_calls":10,"redis_duration_s":0.002991,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000636,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001726,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000629,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00045814,"duration_s":0.035434,"completed_at":"2026-09-04T07:29:00.154Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001232,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 287.638937] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.156Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"cc9d6ee918851e81b50afc83","created_at":"2026-09-04T07:28:56.941Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8c9f2fbdc44c00b7fe488f6ab34dda7e","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:57.063Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-cc9d6ee918851e81b50afc83: start","job_status":"start","queue_duration_s":3.093163,"scheduling_latency_s":3.093192}1357gitlab # [ 287.652451] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.194Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"cc9d6ee918851e81b50afc83","created_at":"2026-09-04T07:28:56.941Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8c9f2fbdc44c00b7fe488f6ab34dda7e","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:57.063Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-cc9d6ee918851e81b50afc83: done: 0.037926 sec","job_status":"done","queue_duration_s":3.093163,"scheduling_latency_s":3.093192,"redis_calls":12,"redis_duration_s":0.004664,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.001138,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000628,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002244,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000654,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022668,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00111202,"duration_s":0.037926,"completed_at":"2026-09-04T07:29:00.194Z","load_balancing_strategy":"primary","db_duration_s":0.000857,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 287.697442] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.196Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"8064d5ec03d6834a7b47403d","created_at":"2026-09-04T07:28:57.111Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"209d84327f616588b4f0e0b287782f0a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:57.137Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-8064d5ec03d6834a7b47403d: start","job_status":"start","queue_duration_s":3.059405,"scheduling_latency_s":3.059438}1359gitlab # [ 287.712330] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.255Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"8064d5ec03d6834a7b47403d","created_at":"2026-09-04T07:28:57.111Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"209d84327f616588b4f0e0b287782f0a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:57.137Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-8064d5ec03d6834a7b47403d: done: 0.058947 sec","job_status":"done","queue_duration_s":3.059405,"scheduling_latency_s":3.059438,"redis_calls":19,"redis_duration_s":0.006312,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001176,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000551,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003633,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000952,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041487,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00045578,"duration_s":0.058947,"completed_at":"2026-09-04T07:29:00.255Z","load_balancing_strategy":"primary","db_duration_s":0.004902,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 287.756896] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.258Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"7afccec03e7606a279d596c4","created_at":"2026-09-04T07:28:57.176Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c789b6235382362b108d88b574c33100","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:57.198Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-7afccec03e7606a279d596c4: start","job_status":"start","queue_duration_s":3.059863,"scheduling_latency_s":3.059896}1361gitlab # [ 287.772427] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.276Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1362gitlab # [ 287.776443] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.286Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"7afccec03e7606a279d596c4","created_at":"2026-09-04T07:28:57.176Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c789b6235382362b108d88b574c33100","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:57.198Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-7afccec03e7606a279d596c4: done: 0.028253 sec","job_status":"done","queue_duration_s":3.059863,"scheduling_latency_s":3.059896,"redis_calls":10,"redis_duration_s":0.0031260000000000003,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000732,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001783,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000611,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016125,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00041082,"duration_s":0.028253,"completed_at":"2026-09-04T07:29:00.286Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000989,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 287.821233] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.288Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"04602fe5beef94cda12dc6b4","created_at":"2026-09-04T07:28:57.266Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"94080af5d84dd93f57192d47894b58a1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:57.279Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-04602fe5beef94cda12dc6b4: start","job_status":"start","queue_duration_s":3.009218,"scheduling_latency_s":3.009245}1364gitlab # [ 287.836843] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.355Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"04602fe5beef94cda12dc6b4","created_at":"2026-09-04T07:28:57.266Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"94080af5d84dd93f57192d47894b58a1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:57.279Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-04602fe5beef94cda12dc6b4: done: 0.06627 sec","job_status":"done","queue_duration_s":3.009218,"scheduling_latency_s":3.009245,"redis_calls":12,"redis_duration_s":0.004557,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000736,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002055,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001766,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030982,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00113402,"exclusive_lock_hold_duration_s":0.026111,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.06627,"completed_at":"2026-09-04T07:29:00.354Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025146,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 287.884143] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.357Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"d5fe958ecdf13a298a198f56","created_at":"2026-09-04T07:28:57.313Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"399f9c6921b8535db71834d6a16b7c0d","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:57.345Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-d5fe958ecdf13a298a198f56: start","job_status":"start","queue_duration_s":3.012599,"scheduling_latency_s":3.012628}1366gitlab # [ 287.898561] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.838Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"d5fe958ecdf13a298a198f56","created_at":"2026-09-04T07:28:57.313Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"399f9c6921b8535db71834d6a16b7c0d","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:57.345Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-d5fe958ecdf13a298a198f56: done: 0.481055 sec","job_status":"done","queue_duration_s":3.012599,"scheduling_latency_s":3.012628,"redis_calls":565,"redis_duration_s":0.122323,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001056,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00157,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.119697,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.407364,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000598,"duration_s":0.481055,"completed_at":"2026-09-04T07:29:00.838Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004679,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 287.941693] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.840Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"cb76b21ddc9d113bb77c5fad","created_at":"2026-09-04T07:28:57.394Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f4b731dc398690cc7884fd106f47a64a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:57.427Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-cb76b21ddc9d113bb77c5fad: start","job_status":"start","queue_duration_s":3.413126,"scheduling_latency_s":3.413157}1368gitlab # [ 287.955508] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.882Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"cb76b21ddc9d113bb77c5fad","created_at":"2026-09-04T07:28:57.394Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f4b731dc398690cc7884fd106f47a64a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:57.427Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-cb76b21ddc9d113bb77c5fad: done: 0.042178 sec","job_status":"done","queue_duration_s":3.413126,"scheduling_latency_s":3.413157,"redis_calls":12,"redis_duration_s":0.003848,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000589,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00183,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001429,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00080598,"exclusive_lock_hold_duration_s":0.013257960000000001,"duration_s":0.042178,"completed_at":"2026-09-04T07:29:00.882Z","load_balancing_strategy":"primary","db_duration_s":0.006967,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 287.998308] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.884Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"3b412627502e7d852668cd09","created_at":"2026-09-04T07:28:57.434Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8906ab7fa524c0774d05ad795c538aff","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:57.455Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-3b412627502e7d852668cd09: start","job_status":"start","queue_duration_s":3.429095,"scheduling_latency_s":3.429124}1370gitlab # [ 288.013086] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.902Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1371gitlab # [ 288.016367] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.913Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"3b412627502e7d852668cd09","created_at":"2026-09-04T07:28:57.434Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8906ab7fa524c0774d05ad795c538aff","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:57.455Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-3b412627502e7d852668cd09: done: 0.02823 sec","job_status":"done","queue_duration_s":3.429095,"scheduling_latency_s":3.429124,"redis_calls":10,"redis_duration_s":0.003064,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000701,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001722,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000641,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039016,"duration_s":0.02823,"completed_at":"2026-09-04T07:29:00.912Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00084,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 288.059095] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.918Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"213556b9eb2c082cf4e3d33a","created_at":"2026-09-04T07:28:57.469Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a612ddf29f25d13a5b73f199c2e9360f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:28:57.488Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-213556b9eb2c082cf4e3d33a: start","job_status":"start","queue_duration_s":3.430118,"scheduling_latency_s":3.430177}1373gitlab # [ 288.072796] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.951Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1374gitlab # [ 288.076082] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.969Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"213556b9eb2c082cf4e3d33a","created_at":"2026-09-04T07:28:57.469Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a612ddf29f25d13a5b73f199c2e9360f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:28:57.488Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-213556b9eb2c082cf4e3d33a: done: 0.050994 sec","job_status":"done","queue_duration_s":3.430118,"scheduling_latency_s":3.430177,"redis_calls":10,"redis_duration_s":0.0034289999999999998,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000676,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002015,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000738,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006288,"duration_s":0.050994,"completed_at":"2026-09-04T07:29:00.969Z","load_balancing_strategy":"primary","db_duration_s":0.000947,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 288.119479] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:00.972Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"668ff88397fda3e2d4895869","created_at":"2026-09-04T07:28:57.509Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8c39e6293c0c5fedb5fc82f2bb6f91c7","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:57.523Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-668ff88397fda3e2d4895869: start","job_status":"start","queue_duration_s":3.449659,"scheduling_latency_s":3.449708}1376gitlab # [ 288.134705] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:01.037Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"668ff88397fda3e2d4895869","created_at":"2026-09-04T07:28:57.509Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8c39e6293c0c5fedb5fc82f2bb6f91c7","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:57.523Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-668ff88397fda3e2d4895869: done: 0.064497 sec","job_status":"done","queue_duration_s":3.449659,"scheduling_latency_s":3.449708,"redis_calls":12,"redis_duration_s":0.005497,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000929,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002569,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001999,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036283,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00120342,"exclusive_lock_hold_duration_s":0.01205172,"duration_s":0.064497,"completed_at":"2026-09-04T07:29:01.037Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005643,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 288.178349] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:01.048Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"c114e9cb7555d30c084457a4","created_at":"2026-09-04T07:28:57.538Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5ec1f656392880bcbc886e5e30f3cf0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:57.551Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-c114e9cb7555d30c084457a4: start","job_status":"start","queue_duration_s":3.497229,"scheduling_latency_s":3.497282}1378gitlab # [ 288.193187] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:01.348Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"c114e9cb7555d30c084457a4","created_at":"2026-09-04T07:28:57.538Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5ec1f656392880bcbc886e5e30f3cf0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:57.551Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-c114e9cb7555d30c084457a4: done: 0.29995 sec","job_status":"done","queue_duration_s":3.497229,"scheduling_latency_s":3.497282,"redis_calls":12,"redis_duration_s":0.006082,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001011,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002758,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002313,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.253883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00126952,"exclusive_lock_hold_duration_s":0.25275764,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.29995,"completed_at":"2026-09-04T07:29:01.348Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032034,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null}1379gitlab # [ 288.237896] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:01.351Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"abd06ecca6aa73d020026de3","created_at":"2026-09-04T07:28:57.559Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5fd88ec051498499c487d96338f5bf82","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:28:57.577Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-abd06ecca6aa73d020026de3: start","job_status":"start","queue_duration_s":3.773602,"scheduling_latency_s":3.773632}1380gitlab # [ 288.251565] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:01.398Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"abd06ecca6aa73d020026de3","created_at":"2026-09-04T07:28:57.559Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5fd88ec051498499c487d96338f5bf82","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:28:57.577Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-abd06ecca6aa73d020026de3: done: 0.047809 sec","job_status":"done","queue_duration_s":3.773602,"scheduling_latency_s":3.773632,"redis_calls":10,"redis_duration_s":0.003538,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000725,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002078,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000735,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00057454,"duration_s":0.047809,"completed_at":"2026-09-04T07:29:01.398Z","load_balancing_strategy":"primary","db_duration_s":0.008653,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 288.294743] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:01.401Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"0faf2115d78a18dbe1fd31c9","created_at":"2026-09-04T07:28:57.611Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"71933c8c453808bf91a7702a99c680b3","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:57.639Z","job_size_bytes":3,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-0faf2115d78a18dbe1fd31c9: start","job_status":"start","queue_duration_s":3.761518,"scheduling_latency_s":3.761549}1382gitlab # [ 288.309020] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:01.428Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"0faf2115d78a18dbe1fd31c9","created_at":"2026-09-04T07:28:57.611Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"71933c8c453808bf91a7702a99c680b3","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:57.639Z","job_size_bytes":3,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-0faf2115d78a18dbe1fd31c9: done: 0.027371 sec","job_status":"done","queue_duration_s":3.761518,"scheduling_latency_s":3.761549,"redis_calls":10,"redis_duration_s":0.003251,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000812,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001793,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000646,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015273,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00041092,"duration_s":0.027371,"completed_at":"2026-09-04T07:29:01.428Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001021,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 288.351231] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:01.430Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0602c312a17522075869e30a","created_at":"2026-09-04T07:29:00.222Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-37f5a010f4504d9c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"209d84327f616588b4f0e0b287782f0a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:00.244Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0602c312a17522075869e30a: start","job_status":"start","queue_duration_s":1.186497,"scheduling_latency_s":1.186523}1384gitlab # [ 288.363915] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:01.455Z","message":"No existing merge request to be cleaned up."}1385gitlab # [ 288.365731] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:01.494Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0602c312a17522075869e30a","created_at":"2026-09-04T07:29:00.222Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-37f5a010f4504d9c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"209d84327f616588b4f0e0b287782f0a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:00.244Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0602c312a17522075869e30a: done: 0.063836 sec","job_status":"done","queue_duration_s":1.186497,"scheduling_latency_s":1.186523,"redis_calls":13,"redis_duration_s":0.006362,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000771,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002309,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003282,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00112802,"duration_s":0.063836,"completed_at":"2026-09-04T07:29:01.494Z","load_balancing_strategy":"primary","db_duration_s":0.006664,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 288.406392] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:01.498Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4fac71229ee07ee9f0d3faf9","created_at":"2026-09-04T07:29:00.222Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-37f5a010f4504d9c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"209d84327f616588b4f0e0b287782f0a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:00.244Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4fac71229ee07ee9f0d3faf9: start","job_status":"start","queue_duration_s":1.254516,"scheduling_latency_s":1.254573}1387gitlab # [ 288.418844] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:01.529Z","message":"No existing merge request to be cleaned up."}1388gitlab # [ 288.420577] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:01.552Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4fac71229ee07ee9f0d3faf9","created_at":"2026-09-04T07:29:00.222Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-37f5a010f4504d9c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"209d84327f616588b4f0e0b287782f0a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:00.244Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4fac71229ee07ee9f0d3faf9: done: 0.05378 sec","job_status":"done","queue_duration_s":1.254516,"scheduling_latency_s":1.254573,"redis_calls":10,"redis_duration_s":0.004419,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00181,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002609,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037595,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.05378,"completed_at":"2026-09-04T07:29:01.552Z","load_balancing_strategy":"primary","db_duration_s":0.003529,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 288.459701] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:01.555Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7bcd66930495a9a74be59b98","created_at":"2026-09-04T07:29:00.222Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-37f5a010f4504d9c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"209d84327f616588b4f0e0b287782f0a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:00.244Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7bcd66930495a9a74be59b98: start","job_status":"start","queue_duration_s":1.311358,"scheduling_latency_s":1.311403}1390gitlab # [ 288.472366] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:01.580Z","message":"No existing merge request to be cleaned up."}1391gitlab # [ 288.474042] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:01.599Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7bcd66930495a9a74be59b98","created_at":"2026-09-04T07:29:00.222Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-37f5a010f4504d9c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"209d84327f616588b4f0e0b287782f0a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:00.244Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7bcd66930495a9a74be59b98: done: 0.044447 sec","job_status":"done","queue_duration_s":1.311358,"scheduling_latency_s":1.311403,"redis_calls":10,"redis_duration_s":0.003636,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002074,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044447,"completed_at":"2026-09-04T07:29:01.599Z","load_balancing_strategy":"primary","db_duration_s":0.003793,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 288.514689] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:01.604Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"64b48272d131adb10f9baabe","created_at":"2026-09-04T07:29:00.222Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-37f5a010f4504d9c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"209d84327f616588b4f0e0b287782f0a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:00.244Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-64b48272d131adb10f9baabe: start","job_status":"start","queue_duration_s":1.359714,"scheduling_latency_s":1.359757}1393gitlab # [ 288.527398] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:01.626Z","message":"No existing merge request to be cleaned up."}1394gitlab # [ 288.529180] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:01.643Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"64b48272d131adb10f9baabe","created_at":"2026-09-04T07:29:00.222Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-37f5a010f4504d9c","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"209d84327f616588b4f0e0b287782f0a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:00.244Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-64b48272d131adb10f9baabe: done: 0.039342 sec","job_status":"done","queue_duration_s":1.359714,"scheduling_latency_s":1.359757,"redis_calls":10,"redis_duration_s":0.003398,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001478,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00192,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027577,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039342,"completed_at":"2026-09-04T07:29:01.643Z","load_balancing_strategy":"primary","db_duration_s":0.003226,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 288.568351] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:02.533Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"85b5094461fdb18d3f133f78","created_at":"2026-09-04T07:29:02.511Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:02.530Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-85b5094461fdb18d3f133f78: start","job_status":"start","queue_duration_s":0.003621,"scheduling_latency_s":0.003682}1396gitlab # [ 288.582054] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:03.561Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"85b5094461fdb18d3f133f78","created_at":"2026-09-04T07:29:02.511Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:02.530Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-85b5094461fdb18d3f133f78: done: 1.028125 sec","job_status":"done","queue_duration_s":0.003621,"scheduling_latency_s":0.003682,"redis_calls":60,"redis_duration_s":0.25587899999999997,"redis_read_bytes":108,"redis_write_bytes":41059,"redis_queues_calls":2,"redis_queues_duration_s":0.003339,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.243743,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.008797,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.314186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.028125,"completed_at":"2026-09-04T07:29:03.561Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 288.624761] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:03.570Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"d5dd0cf3cea8fcbf824a04bc","created_at":"2026-09-04T07:29:02.554Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"275fad201fe1bcbe4f9233048b23f57f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:29:02.562Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-d5dd0cf3cea8fcbf824a04bc: start","job_status":"start","queue_duration_s":1.008315,"scheduling_latency_s":1.00838}1398gitlab # [ 288.638153] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:03.664Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1399gitlab # [ 288.642019] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:03.735Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"d5dd0cf3cea8fcbf824a04bc","created_at":"2026-09-04T07:29:02.554Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"275fad201fe1bcbe4f9233048b23f57f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:29:02.562Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-d5dd0cf3cea8fcbf824a04bc: done: 0.165127 sec","job_status":"done","queue_duration_s":1.008315,"scheduling_latency_s":1.00838,"redis_calls":7,"redis_duration_s":0.060288,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.011527,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.048761,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034971,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.165127,"completed_at":"2026-09-04T07:29:03.735Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 288.682419] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:03.743Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"c236b6d14b0da008b0203a13","created_at":"2026-09-04T07:29:02.573Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8fa74e5287de3153dd9cc141f1cf992","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:02.583Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-c236b6d14b0da008b0203a13: start","job_status":"start","queue_duration_s":1.159733,"scheduling_latency_s":1.159803}1401gitlab # [ 288.698625] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:03.806Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"c236b6d14b0da008b0203a13","created_at":"2026-09-04T07:29:02.573Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8fa74e5287de3153dd9cc141f1cf992","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:02.583Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-c236b6d14b0da008b0203a13: done: 0.063469 sec","job_status":"done","queue_duration_s":1.159733,"scheduling_latency_s":1.159803,"redis_calls":10,"redis_duration_s":0.0055309999999999995,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003104,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002427,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044705,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0129739,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.063469,"completed_at":"2026-09-04T07:29:03.806Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004865,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1402gitlab # [ 288.743373] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:03.809Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"d3e767b0598dffe4f3fbe844","created_at":"2026-09-04T07:29:02.627Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2c86e48ec03da98fe146830d124ee362","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:02.646Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-d3e767b0598dffe4f3fbe844: start","job_status":"start","queue_duration_s":1.163609,"scheduling_latency_s":1.163656}1403gitlab # [ 288.759136] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:03.894Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"d3e767b0598dffe4f3fbe844","created_at":"2026-09-04T07:29:02.627Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2c86e48ec03da98fe146830d124ee362","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:02.646Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-d3e767b0598dffe4f3fbe844: done: 0.08505 sec","job_status":"done","queue_duration_s":1.163609,"scheduling_latency_s":1.163656,"redis_calls":9,"redis_duration_s":0.004043,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002071,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001972,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.019,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050808,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00116502,"exclusive_lock_hold_duration_s":0.04745182,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.08505,"completed_at":"2026-09-04T07:29:03.894Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021756,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 288.805432] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:03.898Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"0c4bb705d4caf4f95399ecc1","created_at":"2026-09-04T07:29:02.695Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4e86ce5289fc7a60fba5350f44dfb187","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:02.709Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-0c4bb705d4caf4f95399ecc1: start","job_status":"start","queue_duration_s":1.188656,"scheduling_latency_s":1.188701}1405gitlab # [ 288.820279] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:03.928Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"0c4bb705d4caf4f95399ecc1","created_at":"2026-09-04T07:29:02.695Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4e86ce5289fc7a60fba5350f44dfb187","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:02.709Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-0c4bb705d4caf4f95399ecc1: done: 0.030109 sec","job_status":"done","queue_duration_s":1.188656,"scheduling_latency_s":1.188701,"redis_calls":7,"redis_duration_s":0.0025120000000000003,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001734,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000778,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018648,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030109,"completed_at":"2026-09-04T07:29:03.928Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001398,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 288.863671] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:03.930Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"3e45be2159636523fd6f000c","created_at":"2026-09-04T07:29:02.913Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c70aea08d68e05067235d17797c2c55","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:02.921Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-3e45be2159636523fd6f000c: start","job_status":"start","queue_duration_s":1.008801,"scheduling_latency_s":1.008842}1407gitlab # [ 288.894663] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:03.952Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"3e45be2159636523fd6f000c","created_at":"2026-09-04T07:29:02.913Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c70aea08d68e05067235d17797c2c55","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:02.921Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-3e45be2159636523fd6f000c: done: 0.021935 sec","job_status":"done","queue_duration_s":1.008801,"scheduling_latency_s":1.008842,"redis_calls":7,"redis_duration_s":0.002016,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001438,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000578,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012348,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021935,"completed_at":"2026-09-04T07:29:03.952Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 288.953707] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:03.954Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"4851f3733ccd1d1e50d41c8a","created_at":"2026-09-04T07:29:02.954Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b8ad6d2657be91559d98426efb55fb8f","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:02.964Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-4851f3733ccd1d1e50d41c8a: start","job_status":"start","queue_duration_s":0.990032,"scheduling_latency_s":0.990065}1409gitlab # [ 288.969029] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:03.989Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"4851f3733ccd1d1e50d41c8a","created_at":"2026-09-04T07:29:02.954Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b8ad6d2657be91559d98426efb55fb8f","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:02.964Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-4851f3733ccd1d1e50d41c8a: done: 0.034424 sec","job_status":"done","queue_duration_s":0.990032,"scheduling_latency_s":0.990065,"redis_calls":7,"redis_duration_s":0.0024590000000000002,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001793,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000666,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018895,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034424,"completed_at":"2026-09-04T07:29:03.988Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006874,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 289.009645] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:03.991Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"041cb2ee73923849e9787618","created_at":"2026-09-04T07:29:02.988Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"550d39653d6fbebbf6a69401aa379020","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:02.998Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-041cb2ee73923849e9787618: start","job_status":"start","queue_duration_s":0.992505,"scheduling_latency_s":0.992543}1411gitlab # [ 289.024041] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.002Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1412gitlab # [ 289.027570] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.011Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"041cb2ee73923849e9787618","created_at":"2026-09-04T07:29:02.988Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"550d39653d6fbebbf6a69401aa379020","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:02.998Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-041cb2ee73923849e9787618: done: 0.020171 sec","job_status":"done","queue_duration_s":0.992505,"scheduling_latency_s":0.992543,"redis_calls":7,"redis_duration_s":0.002196,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001491,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000705,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012323,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020171,"completed_at":"2026-09-04T07:29:04.011Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 289.068136] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.013Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"ab5c9da09b7b31d2707a5bd1","created_at":"2026-09-04T07:29:03.045Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"67c2bbf31530cffa4ef5c7d628076376","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.059Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-ab5c9da09b7b31d2707a5bd1: start","job_status":"start","queue_duration_s":0.954508,"scheduling_latency_s":0.954539}1414gitlab # [ 289.082026] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.039Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"ab5c9da09b7b31d2707a5bd1","created_at":"2026-09-04T07:29:03.045Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"67c2bbf31530cffa4ef5c7d628076376","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.059Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-ab5c9da09b7b31d2707a5bd1: done: 0.025611 sec","job_status":"done","queue_duration_s":0.954508,"scheduling_latency_s":0.954539,"redis_calls":7,"redis_duration_s":0.0019820000000000003,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001407,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000575,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.025611,"completed_at":"2026-09-04T07:29:04.039Z","load_balancing_strategy":"primary","db_duration_s":0.004292,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 289.124838] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.041Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"a553a13d45d5448aff592d25","created_at":"2026-09-04T07:29:03.082Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d914680f01dac72a7c1c48c52965b34d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.099Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-a553a13d45d5448aff592d25: start","job_status":"start","queue_duration_s":0.941523,"scheduling_latency_s":0.941554}1416gitlab # [ 289.139081] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.336Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"a553a13d45d5448aff592d25","created_at":"2026-09-04T07:29:03.082Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d914680f01dac72a7c1c48c52965b34d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.099Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-a553a13d45d5448aff592d25: done: 0.295501 sec","job_status":"done","queue_duration_s":0.941523,"scheduling_latency_s":0.941554,"redis_calls":9,"redis_duration_s":0.002774,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001384,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00139,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.053,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.053,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.226144,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00072406,"exclusive_lock_hold_duration_s":0.27541858,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.295501,"completed_at":"2026-09-04T07:29:04.336Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.082484,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 289.182416] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.339Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"92240cec0287a370564cb565","created_at":"2026-09-04T07:29:03.144Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3eb5699c2b3e377b77018b41e0fc1f90","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.153Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-92240cec0287a370564cb565: start","job_status":"start","queue_duration_s":1.186187,"scheduling_latency_s":1.186214}1418gitlab # [ 289.196936] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.360Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"92240cec0287a370564cb565","created_at":"2026-09-04T07:29:03.144Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3eb5699c2b3e377b77018b41e0fc1f90","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.153Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-92240cec0287a370564cb565: done: 0.021246 sec","job_status":"done","queue_duration_s":1.186187,"scheduling_latency_s":1.186214,"redis_calls":9,"redis_duration_s":0.003359,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002204,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001155,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0133,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00062684,"exclusive_lock_hold_duration_s":0.00308216,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.021246,"completed_at":"2026-09-04T07:29:04.360Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000981,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 289.238795] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.362Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"9d8e4c7478840ce0e73027f3","created_at":"2026-09-04T07:29:03.182Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f982121fb4cabfe80ab3f05b46af8788","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.195Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-9d8e4c7478840ce0e73027f3: start","job_status":"start","queue_duration_s":1.167417,"scheduling_latency_s":1.167442}1420gitlab # [ 289.254232] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.379Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"9d8e4c7478840ce0e73027f3","created_at":"2026-09-04T07:29:03.182Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f982121fb4cabfe80ab3f05b46af8788","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.195Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-9d8e4c7478840ce0e73027f3: done: 0.016647 sec","job_status":"done","queue_duration_s":1.167417,"scheduling_latency_s":1.167442,"redis_calls":7,"redis_duration_s":0.001872,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001262,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00061,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010153,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016647,"completed_at":"2026-09-04T07:29:04.379Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 289.295017] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.381Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"e9b9c62a35839d6244f67264","created_at":"2026-09-04T07:29:03.244Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2c39e2d669492ca0e72c1b18095baa2e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.256Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-e9b9c62a35839d6244f67264: start","job_status":"start","queue_duration_s":1.124087,"scheduling_latency_s":1.124114}1422gitlab # [ 289.311150] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.391Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1423gitlab # [ 289.314769] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.397Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"e9b9c62a35839d6244f67264","created_at":"2026-09-04T07:29:03.244Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2c39e2d669492ca0e72c1b18095baa2e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.256Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-e9b9c62a35839d6244f67264: done: 0.016975 sec","job_status":"done","queue_duration_s":1.124087,"scheduling_latency_s":1.124114,"redis_calls":7,"redis_duration_s":0.001955,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001431,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000524,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016975,"completed_at":"2026-09-04T07:29:04.397Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 289.355970] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.399Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"a3ca2ba0cde087f14f05a8a3","created_at":"2026-09-04T07:29:03.302Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"00e6354c1a1697c25b3d22a351030c61","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.313Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-a3ca2ba0cde087f14f05a8a3: start","job_status":"start","queue_duration_s":1.086354,"scheduling_latency_s":1.08638}1425gitlab # [ 289.369728] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.434Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"a3ca2ba0cde087f14f05a8a3","created_at":"2026-09-04T07:29:03.302Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"00e6354c1a1697c25b3d22a351030c61","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.313Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-a3ca2ba0cde087f14f05a8a3: done: 0.034425 sec","job_status":"done","queue_duration_s":1.086354,"scheduling_latency_s":1.08638,"redis_calls":14,"redis_duration_s":0.004318,"redis_read_bytes":16,"redis_write_bytes":4026,"redis_queues_calls":2,"redis_queues_duration_s":0.000689,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002626,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001003,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025527,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034425,"completed_at":"2026-09-04T07:29:04.434Z","load_balancing_strategy":"primary","db_duration_s":0.001132,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 289.410747] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.436Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"99af0d3cb0348ac151ee9ea7","created_at":"2026-09-04T07:29:03.343Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2136cefe8f48598c29750ad306c098a8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.362Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-99af0d3cb0348ac151ee9ea7: start","job_status":"start","queue_duration_s":1.073488,"scheduling_latency_s":1.073518}1427gitlab # [ 289.425539] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.446Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1428gitlab # [ 289.429351] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.453Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"99af0d3cb0348ac151ee9ea7","created_at":"2026-09-04T07:29:03.343Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2136cefe8f48598c29750ad306c098a8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.362Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-99af0d3cb0348ac151ee9ea7: done: 0.017848 sec","job_status":"done","queue_duration_s":1.073488,"scheduling_latency_s":1.073518,"redis_calls":7,"redis_duration_s":0.001911,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001356,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000555,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010255,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017848,"completed_at":"2026-09-04T07:29:04.453Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 289.470383] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.455Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"2136f5dc1e7795c70a6f4126","created_at":"2026-09-04T07:29:03.450Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bfc1fa2bae19730e516163917af4b6ca","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.464Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-2136f5dc1e7795c70a6f4126: start","job_status":"start","queue_duration_s":0.990819,"scheduling_latency_s":0.990845}1430gitlab # [ 289.485166] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.518Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"2136f5dc1e7795c70a6f4126","created_at":"2026-09-04T07:29:03.450Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bfc1fa2bae19730e516163917af4b6ca","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.464Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-2136f5dc1e7795c70a6f4126: done: 0.06227 sec","job_status":"done","queue_duration_s":0.990819,"scheduling_latency_s":0.990845,"redis_calls":9,"redis_duration_s":0.003195,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001523,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001672,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025288,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00101054,"exclusive_lock_hold_duration_s":0.03186404,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.06227,"completed_at":"2026-09-04T07:29:04.517Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.030588,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 289.531801] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.521Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b859e73bd4e1899cc2117e54","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b859e73bd4e1899cc2117e54: start","job_status":"start","queue_duration_s":1.031531,"scheduling_latency_s":1.031564}1432gitlab # [ 289.545206] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.542Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b859e73bd4e1899cc2117e54","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b859e73bd4e1899cc2117e54: done: 0.021145 sec","job_status":"done","queue_duration_s":1.031531,"scheduling_latency_s":1.031564,"redis_calls":13,"redis_duration_s":0.003297,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001036,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002261,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021145,"completed_at":"2026-09-04T07:29:04.542Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 289.588406] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8574c91fdacb77b2ed67da65","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8574c91fdacb77b2ed67da65: start","job_status":"start","queue_duration_s":1.054522,"scheduling_latency_s":1.054549}1434gitlab # [ 289.602142] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.564Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8574c91fdacb77b2ed67da65","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8574c91fdacb77b2ed67da65: done: 0.019946 sec","job_status":"done","queue_duration_s":1.054522,"scheduling_latency_s":1.054549,"redis_calls":13,"redis_duration_s":0.003194,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001074,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00212,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019946,"completed_at":"2026-09-04T07:29:04.564Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 289.641384] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.567Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5d677cf778ab77d2fd2d761","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5d677cf778ab77d2fd2d761: start","job_status":"start","queue_duration_s":1.076843,"scheduling_latency_s":1.076872}1436gitlab # [ 289.653896] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.586Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5d677cf778ab77d2fd2d761","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5d677cf778ab77d2fd2d761: done: 0.019339 sec","job_status":"done","queue_duration_s":1.076843,"scheduling_latency_s":1.076872,"redis_calls":13,"redis_duration_s":0.003018,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011498,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019339,"completed_at":"2026-09-04T07:29:04.586Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 289.693378] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.588Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1540953b7b36217d1cb9e9c5","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1540953b7b36217d1cb9e9c5: start","job_status":"start","queue_duration_s":1.097903,"scheduling_latency_s":1.09793}1438gitlab # [ 289.705825] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.607Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1540953b7b36217d1cb9e9c5","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1540953b7b36217d1cb9e9c5: done: 0.01909 sec","job_status":"done","queue_duration_s":1.097903,"scheduling_latency_s":1.09793,"redis_calls":13,"redis_duration_s":0.003293,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001025,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002268,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011717,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01909,"completed_at":"2026-09-04T07:29:04.607Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 289.747408] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.609Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3b11d6acf9077e5a6d47037","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3b11d6acf9077e5a6d47037: start","job_status":"start","queue_duration_s":1.118801,"scheduling_latency_s":1.118829}1440gitlab # [ 289.760434] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.628Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3b11d6acf9077e5a6d47037","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3b11d6acf9077e5a6d47037: done: 0.0196 sec","job_status":"done","queue_duration_s":1.118801,"scheduling_latency_s":1.118829,"redis_calls":13,"redis_duration_s":0.0032779999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001087,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002191,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012046,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0196,"completed_at":"2026-09-04T07:29:04.628Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 289.801950] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.630Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3ba8dda26baa2833fd5c150","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3ba8dda26baa2833fd5c150: start","job_status":"start","queue_duration_s":1.140685,"scheduling_latency_s":1.140714}1442gitlab # [ 289.815611] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.650Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3ba8dda26baa2833fd5c150","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3ba8dda26baa2833fd5c150: done: 0.019224 sec","job_status":"done","queue_duration_s":1.140685,"scheduling_latency_s":1.140714,"redis_calls":13,"redis_duration_s":0.003123,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001102,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011671,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019224,"completed_at":"2026-09-04T07:29:04.649Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 289.857655] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.651Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f39b7a9648ae5719a8797c66","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f39b7a9648ae5719a8797c66: start","job_status":"start","queue_duration_s":1.161748,"scheduling_latency_s":1.161771}1444gitlab # [ 289.871247] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f39b7a9648ae5719a8797c66","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f39b7a9648ae5719a8797c66: done: 0.019865 sec","job_status":"done","queue_duration_s":1.161748,"scheduling_latency_s":1.161771,"redis_calls":13,"redis_duration_s":0.0032649999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001155,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00211,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019865,"completed_at":"2026-09-04T07:29:04.671Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 289.916199] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.673Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b54458170690b38b044122a6","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b54458170690b38b044122a6: start","job_status":"start","queue_duration_s":1.183684,"scheduling_latency_s":1.183713}1446gitlab # [ 289.929436] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.694Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b54458170690b38b044122a6","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b54458170690b38b044122a6: done: 0.020507 sec","job_status":"done","queue_duration_s":1.183684,"scheduling_latency_s":1.183713,"redis_calls":13,"redis_duration_s":0.003273,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001109,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002164,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012171,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020507,"completed_at":"2026-09-04T07:29:04.694Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 289.971091] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f3307b840d40d4a9fd466b8","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f3307b840d40d4a9fd466b8: start","job_status":"start","queue_duration_s":1.206,"scheduling_latency_s":1.206026}1448gitlab # [ 289.983911] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.715Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f3307b840d40d4a9fd466b8","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f3307b840d40d4a9fd466b8: done: 0.019425 sec","job_status":"done","queue_duration_s":1.206,"scheduling_latency_s":1.206026,"redis_calls":13,"redis_duration_s":0.0029240000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001033,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001891,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011521,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019425,"completed_at":"2026-09-04T07:29:04.715Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 290.025357] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.717Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a878165f461809be82acc052","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a878165f461809be82acc052: start","job_status":"start","queue_duration_s":1.227261,"scheduling_latency_s":1.227287}1450gitlab # [ 290.039175] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.736Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a878165f461809be82acc052","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a878165f461809be82acc052: done: 0.019551 sec","job_status":"done","queue_duration_s":1.227261,"scheduling_latency_s":1.227287,"redis_calls":13,"redis_duration_s":0.003202,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001069,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002133,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019551,"completed_at":"2026-09-04T07:29:04.736Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 290.082578] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.738Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61e7f8d0c95ea7fdf23c2702","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61e7f8d0c95ea7fdf23c2702: start","job_status":"start","queue_duration_s":1.248702,"scheduling_latency_s":1.248727}1452gitlab # [ 290.095514] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.759Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61e7f8d0c95ea7fdf23c2702","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61e7f8d0c95ea7fdf23c2702: done: 0.020219 sec","job_status":"done","queue_duration_s":1.248702,"scheduling_latency_s":1.248727,"redis_calls":13,"redis_duration_s":0.0030989999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001094,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012736,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020219,"completed_at":"2026-09-04T07:29:04.759Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 290.140683] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.761Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"794bd0401f3cba66a8750786","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-794bd0401f3cba66a8750786: start","job_status":"start","queue_duration_s":1.270823,"scheduling_latency_s":1.270851}1454gitlab # [ 290.154823] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"794bd0401f3cba66a8750786","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-794bd0401f3cba66a8750786: done: 0.020608 sec","job_status":"done","queue_duration_s":1.270823,"scheduling_latency_s":1.270851,"redis_calls":13,"redis_duration_s":0.00377,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001642,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002128,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020608,"completed_at":"2026-09-04T07:29:04.781Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 290.196304] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.784Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7440db5407815fa1c8c2845b","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7440db5407815fa1c8c2845b: start","job_status":"start","queue_duration_s":1.294058,"scheduling_latency_s":1.294085}1456gitlab # [ 290.209166] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.802Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7440db5407815fa1c8c2845b","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7440db5407815fa1c8c2845b: done: 0.017905 sec","job_status":"done","queue_duration_s":1.294058,"scheduling_latency_s":1.294085,"redis_calls":13,"redis_duration_s":0.0027229999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00101,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001713,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010888,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017905,"completed_at":"2026-09-04T07:29:04.802Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 290.251044] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.804Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9db698ac299fec0b51dc7f4","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9db698ac299fec0b51dc7f4: start","job_status":"start","queue_duration_s":1.313777,"scheduling_latency_s":1.313803}1458gitlab # [ 290.264590] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.823Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9db698ac299fec0b51dc7f4","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9db698ac299fec0b51dc7f4: done: 0.019393 sec","job_status":"done","queue_duration_s":1.313777,"scheduling_latency_s":1.313803,"redis_calls":13,"redis_duration_s":0.0038060000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001208,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002598,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011715,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019393,"completed_at":"2026-09-04T07:29:04.823Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 290.305454] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.825Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5923efa05384d05c9322bb3c","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5923efa05384d05c9322bb3c: start","job_status":"start","queue_duration_s":1.335048,"scheduling_latency_s":1.335074}1460gitlab # [ 290.318131] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.844Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5923efa05384d05c9322bb3c","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5923efa05384d05c9322bb3c: done: 0.019266 sec","job_status":"done","queue_duration_s":1.335048,"scheduling_latency_s":1.335074,"redis_calls":13,"redis_duration_s":0.003221,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001068,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002153,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011788,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019266,"completed_at":"2026-09-04T07:29:04.844Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461gitlab # [ 290.360072] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98f56456279943f0efbbb032","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98f56456279943f0efbbb032: start","job_status":"start","queue_duration_s":1.356379,"scheduling_latency_s":1.356406}1462gitlab # [ 290.372526] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.866Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98f56456279943f0efbbb032","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98f56456279943f0efbbb032: done: 0.019542 sec","job_status":"done","queue_duration_s":1.356379,"scheduling_latency_s":1.356406,"redis_calls":13,"redis_duration_s":0.0033510000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00117,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002181,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019542,"completed_at":"2026-09-04T07:29:04.866Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 290.412171] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.867Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f73881d733e1031a06106d38","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f73881d733e1031a06106d38: start","job_status":"start","queue_duration_s":1.37774,"scheduling_latency_s":1.377765}1464gitlab # [ 290.424371] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f73881d733e1031a06106d38","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f73881d733e1031a06106d38: done: 0.01984 sec","job_status":"done","queue_duration_s":1.37774,"scheduling_latency_s":1.377765,"redis_calls":13,"redis_duration_s":0.003857,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001136,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002721,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01984,"completed_at":"2026-09-04T07:29:04.887Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465gitlab # [ 290.463950] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.889Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2dab3f3185ece01ddee145f","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2dab3f3185ece01ddee145f: start","job_status":"start","queue_duration_s":1.399427,"scheduling_latency_s":1.399454}1466gitlab # [ 290.477539] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.909Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2dab3f3185ece01ddee145f","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2dab3f3185ece01ddee145f: done: 0.019599 sec","job_status":"done","queue_duration_s":1.399427,"scheduling_latency_s":1.399454,"redis_calls":13,"redis_duration_s":0.003158,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00107,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019599,"completed_at":"2026-09-04T07:29:04.909Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1467gitlab # [ 290.518887] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.912Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7c92950e5e3b95aa16d972e","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7c92950e5e3b95aa16d972e: start","job_status":"start","queue_duration_s":1.422518,"scheduling_latency_s":1.422575}1468gitlab # [ 290.533068] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.961Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7c92950e5e3b95aa16d972e","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7c92950e5e3b95aa16d972e: done: 0.048695 sec","job_status":"done","queue_duration_s":1.422518,"scheduling_latency_s":1.422575,"redis_calls":13,"redis_duration_s":0.006718,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001864,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004854,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.048695,"completed_at":"2026-09-04T07:29:04.961Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1469gitlab # [ 290.573430] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.964Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"288dbc0e3d5f64fa0ce47a67","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-288dbc0e3d5f64fa0ce47a67: start","job_status":"start","queue_duration_s":1.474365,"scheduling_latency_s":1.474418}1470gitlab # [ 290.586325] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.996Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"288dbc0e3d5f64fa0ce47a67","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-288dbc0e3d5f64fa0ce47a67: done: 0.03257 sec","job_status":"done","queue_duration_s":1.474365,"scheduling_latency_s":1.474418,"redis_calls":13,"redis_duration_s":0.0034609999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001188,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002273,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020242,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03257,"completed_at":"2026-09-04T07:29:04.996Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1471gitlab # [ 290.629188] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:04.999Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e976a4685b9fd5f0144b6260","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e976a4685b9fd5f0144b6260: start","job_status":"start","queue_duration_s":1.509143,"scheduling_latency_s":1.509178}1472gitlab # [ 290.643258] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.023Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e976a4685b9fd5f0144b6260","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e976a4685b9fd5f0144b6260: done: 0.024226 sec","job_status":"done","queue_duration_s":1.509143,"scheduling_latency_s":1.509178,"redis_calls":13,"redis_duration_s":0.0033680000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001168,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01528,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024226,"completed_at":"2026-09-04T07:29:05.023Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1473gitlab # [ 290.686652] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.025Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2682376dd918fe3c561b8d5","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2682376dd918fe3c561b8d5: start","job_status":"start","queue_duration_s":1.535504,"scheduling_latency_s":1.535537}1474gitlab # [ 290.699229] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.047Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2682376dd918fe3c561b8d5","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2682376dd918fe3c561b8d5: done: 0.021653 sec","job_status":"done","queue_duration_s":1.535504,"scheduling_latency_s":1.535537,"redis_calls":13,"redis_duration_s":0.003265,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001101,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002164,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012516,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021653,"completed_at":"2026-09-04T07:29:05.047Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1475gitlab # [ 290.741612] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.049Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9bbb15654930281d64edfbc1","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9bbb15654930281d64edfbc1: start","job_status":"start","queue_duration_s":1.559088,"scheduling_latency_s":1.559118}1476gitlab # [ 290.754863] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.069Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9bbb15654930281d64edfbc1","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9bbb15654930281d64edfbc1: done: 0.01999 sec","job_status":"done","queue_duration_s":1.559088,"scheduling_latency_s":1.559118,"redis_calls":13,"redis_duration_s":0.003187,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001078,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012069,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01999,"completed_at":"2026-09-04T07:29:05.069Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477gitlab # [ 290.795256] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.071Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9820f1a58aa980955bbecbb8","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9820f1a58aa980955bbecbb8: start","job_status":"start","queue_duration_s":1.581027,"scheduling_latency_s":1.581056}1478gitlab # [ 290.808093] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.091Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9820f1a58aa980955bbecbb8","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9820f1a58aa980955bbecbb8: done: 0.020166 sec","job_status":"done","queue_duration_s":1.581027,"scheduling_latency_s":1.581056,"redis_calls":13,"redis_duration_s":0.0037939999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001433,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002361,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020166,"completed_at":"2026-09-04T07:29:05.091Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479gitlab # [ 290.850534] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.093Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd8e11ded80016e6fb4718a8","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd8e11ded80016e6fb4718a8: start","job_status":"start","queue_duration_s":1.60311,"scheduling_latency_s":1.60314}1480gitlab # [ 290.864287] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.120Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd8e11ded80016e6fb4718a8","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd8e11ded80016e6fb4718a8: done: 0.027156 sec","job_status":"done","queue_duration_s":1.60311,"scheduling_latency_s":1.60314,"redis_calls":13,"redis_duration_s":0.004275,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001739,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002536,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01661,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027156,"completed_at":"2026-09-04T07:29:05.120Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481gitlab # [ 290.906738] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.126Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d5c01b01b473c172b4e7d3b","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d5c01b01b473c172b4e7d3b: start","job_status":"start","queue_duration_s":1.635959,"scheduling_latency_s":1.636019}1482gitlab # [ 290.920460] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d5c01b01b473c172b4e7d3b","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d5c01b01b473c172b4e7d3b: done: 0.044441 sec","job_status":"done","queue_duration_s":1.635959,"scheduling_latency_s":1.636019,"redis_calls":13,"redis_duration_s":0.004961,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001748,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003213,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029952,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.044441,"completed_at":"2026-09-04T07:29:05.170Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1483gitlab # [ 290.963656] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.173Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36c21e641a7ba08e1856150c","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36c21e641a7ba08e1856150c: start","job_status":"start","queue_duration_s":1.683599,"scheduling_latency_s":1.683644}1484gitlab # [ 290.976858] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.209Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36c21e641a7ba08e1856150c","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36c21e641a7ba08e1856150c: done: 0.035569 sec","job_status":"done","queue_duration_s":1.683599,"scheduling_latency_s":1.683644,"redis_calls":13,"redis_duration_s":0.004319,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002828,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023539,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035569,"completed_at":"2026-09-04T07:29:05.209Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485gitlab # [ 291.017655] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.212Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3357d4077096758a8f53b8af","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3357d4077096758a8f53b8af: start","job_status":"start","queue_duration_s":1.721825,"scheduling_latency_s":1.721869}1486gitlab # [ 291.031061] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3357d4077096758a8f53b8af","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3357d4077096758a8f53b8af: done: 0.0302 sec","job_status":"done","queue_duration_s":1.721825,"scheduling_latency_s":1.721869,"redis_calls":13,"redis_duration_s":0.003861,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00141,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002451,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018809,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0302,"completed_at":"2026-09-04T07:29:05.242Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1487gitlab # [ 291.073320] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.245Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"585f591dc83a32664e179493","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-585f591dc83a32664e179493: start","job_status":"start","queue_duration_s":1.75482,"scheduling_latency_s":1.754859}1488gitlab # [ 291.086418] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"585f591dc83a32664e179493","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-585f591dc83a32664e179493: done: 0.026666 sec","job_status":"done","queue_duration_s":1.75482,"scheduling_latency_s":1.754859,"redis_calls":13,"redis_duration_s":0.003756,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001325,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002431,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026666,"completed_at":"2026-09-04T07:29:05.271Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1489gitlab # [ 291.130833] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36f03b0b42cf3e3f8f95f312","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36f03b0b42cf3e3f8f95f312: start","job_status":"start","queue_duration_s":1.783809,"scheduling_latency_s":1.783843}1490gitlab # [ 291.146308] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.307Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36f03b0b42cf3e3f8f95f312","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36f03b0b42cf3e3f8f95f312: done: 0.032985 sec","job_status":"done","queue_duration_s":1.783809,"scheduling_latency_s":1.783843,"redis_calls":13,"redis_duration_s":0.005669,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001739,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00393,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032985,"completed_at":"2026-09-04T07:29:05.306Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491gitlab # [ 291.189558] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.311Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22024eeed8ca83b6bece8b18","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22024eeed8ca83b6bece8b18: start","job_status":"start","queue_duration_s":1.821657,"scheduling_latency_s":1.821717}1492gitlab # [ 291.203818] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.359Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22024eeed8ca83b6bece8b18","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22024eeed8ca83b6bece8b18: done: 0.047434 sec","job_status":"done","queue_duration_s":1.821657,"scheduling_latency_s":1.821717,"redis_calls":13,"redis_duration_s":0.005221999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001969,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003253,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031527,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.047434,"completed_at":"2026-09-04T07:29:05.359Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1493gitlab # [ 291.247718] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.363Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f06aa933d83ebe8ebbc6163f","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f06aa933d83ebe8ebbc6163f: start","job_status":"start","queue_duration_s":1.872855,"scheduling_latency_s":1.872908}1494gitlab # [ 291.260834] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.399Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f06aa933d83ebe8ebbc6163f","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f06aa933d83ebe8ebbc6163f: done: 0.036085 sec","job_status":"done","queue_duration_s":1.872855,"scheduling_latency_s":1.872908,"redis_calls":13,"redis_duration_s":0.004678,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003172,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023159,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036085,"completed_at":"2026-09-04T07:29:05.398Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1495gitlab # [ 291.301064] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.401Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45922b4e8cf4b05c3604850c","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45922b4e8cf4b05c3604850c: start","job_status":"start","queue_duration_s":1.911564,"scheduling_latency_s":1.911607}1496gitlab # [ 291.314023] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.434Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45922b4e8cf4b05c3604850c","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45922b4e8cf4b05c3604850c: done: 0.032414 sec","job_status":"done","queue_duration_s":1.911564,"scheduling_latency_s":1.911607,"redis_calls":13,"redis_duration_s":0.004009,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001409,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021382,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032414,"completed_at":"2026-09-04T07:29:05.434Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1497gitlab # [ 291.355221] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.436Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25d69e98048e0963d44ee5b7","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25d69e98048e0963d44ee5b7: start","job_status":"start","queue_duration_s":1.946451,"scheduling_latency_s":1.94649}1498gitlab # [ 291.368156] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.464Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25d69e98048e0963d44ee5b7","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25d69e98048e0963d44ee5b7: done: 0.027823 sec","job_status":"done","queue_duration_s":1.946451,"scheduling_latency_s":1.94649,"redis_calls":13,"redis_duration_s":0.0037489999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001303,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002446,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027823,"completed_at":"2026-09-04T07:29:05.464Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1499gitlab # [ 291.408959] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.467Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f223ad18edea29abb64db381","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f223ad18edea29abb64db381: start","job_status":"start","queue_duration_s":1.977696,"scheduling_latency_s":1.977737}1500gitlab # [ 291.421869] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.488Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f223ad18edea29abb64db381","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f223ad18edea29abb64db381: done: 0.020376 sec","job_status":"done","queue_duration_s":1.977696,"scheduling_latency_s":1.977737,"redis_calls":13,"redis_duration_s":0.003391,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001059,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002332,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011412,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020376,"completed_at":"2026-09-04T07:29:05.488Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501gitlab # [ 291.462124] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.490Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"284873bed0939b5840d86c37","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-284873bed0939b5840d86c37: start","job_status":"start","queue_duration_s":1.999851,"scheduling_latency_s":1.999875}1502gitlab # [ 291.474853] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.508Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"284873bed0939b5840d86c37","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-284873bed0939b5840d86c37: done: 0.018845 sec","job_status":"done","queue_duration_s":1.999851,"scheduling_latency_s":1.999875,"redis_calls":13,"redis_duration_s":0.003245,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001026,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002219,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011552,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018845,"completed_at":"2026-09-04T07:29:05.508Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503gitlab # [ 291.515184] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.510Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee7c2625305f4614298a0e71","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee7c2625305f4614298a0e71: start","job_status":"start","queue_duration_s":2.020462,"scheduling_latency_s":2.020487}1504gitlab # [ 291.529152] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.536Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee7c2625305f4614298a0e71","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee7c2625305f4614298a0e71: done: 0.025493 sec","job_status":"done","queue_duration_s":2.020462,"scheduling_latency_s":2.020487,"redis_calls":13,"redis_duration_s":0.008073,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005668,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002405,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01311,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025493,"completed_at":"2026-09-04T07:29:05.536Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505gitlab # [ 291.574056] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.538Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb7e9506fbb7b247c9bc6c50","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb7e9506fbb7b247c9bc6c50: start","job_status":"start","queue_duration_s":2.047973,"scheduling_latency_s":2.048001}1506gitlab # [ 291.588157] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.562Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb7e9506fbb7b247c9bc6c50","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb7e9506fbb7b247c9bc6c50: done: 0.024541 sec","job_status":"done","queue_duration_s":2.047973,"scheduling_latency_s":2.048001,"redis_calls":13,"redis_duration_s":0.006816,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001301,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005515,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012708,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024541,"completed_at":"2026-09-04T07:29:05.562Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 291.628565] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1dc7584c31659429a6babd23","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1dc7584c31659429a6babd23: start","job_status":"start","queue_duration_s":2.075167,"scheduling_latency_s":2.075195}1508gitlab # [ 291.641219] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.608Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1dc7584c31659429a6babd23","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1dc7584c31659429a6babd23: done: 0.042609 sec","job_status":"done","queue_duration_s":2.075167,"scheduling_latency_s":2.075195,"redis_calls":13,"redis_duration_s":0.00441,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001478,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002932,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031043,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.042609,"completed_at":"2026-09-04T07:29:05.607Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509gitlab # [ 291.683466] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.611Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8af032e45b34fe0df66d7d3","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8af032e45b34fe0df66d7d3: start","job_status":"start","queue_duration_s":2.121032,"scheduling_latency_s":2.121085}1510gitlab # [ 291.697215] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.646Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8af032e45b34fe0df66d7d3","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8af032e45b34fe0df66d7d3: done: 0.035823 sec","job_status":"done","queue_duration_s":2.121032,"scheduling_latency_s":2.121085,"redis_calls":13,"redis_duration_s":0.003881,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001344,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002537,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023573,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035823,"completed_at":"2026-09-04T07:29:05.646Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511gitlab # [ 291.738013] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.649Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6587c1d54694e3e9b08c6899","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6587c1d54694e3e9b08c6899: start","job_status":"start","queue_duration_s":2.159398,"scheduling_latency_s":2.159441}1512gitlab # [ 291.753340] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.692Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6587c1d54694e3e9b08c6899","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6587c1d54694e3e9b08c6899: done: 0.042598 sec","job_status":"done","queue_duration_s":2.159398,"scheduling_latency_s":2.159441,"redis_calls":13,"redis_duration_s":0.006023,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002013,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00401,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029442,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.042598,"completed_at":"2026-09-04T07:29:05.692Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513gitlab # [ 291.798193] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7252eeb44f65f669de81697b","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7252eeb44f65f669de81697b: start","job_status":"start","queue_duration_s":2.205877,"scheduling_latency_s":2.205935}1514gitlab # [ 291.811070] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.740Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7252eeb44f65f669de81697b","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7252eeb44f65f669de81697b: done: 0.044464 sec","job_status":"done","queue_duration_s":2.205877,"scheduling_latency_s":2.205935,"redis_calls":13,"redis_duration_s":0.004905,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00174,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003165,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028421,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.044464,"completed_at":"2026-09-04T07:29:05.740Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515gitlab # [ 291.850965] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.744Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e6ad48dc161695b3a9e82f2","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e6ad48dc161695b3a9e82f2: start","job_status":"start","queue_duration_s":2.254049,"scheduling_latency_s":2.254091}1516gitlab # [ 291.864061] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.771Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e6ad48dc161695b3a9e82f2","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e6ad48dc161695b3a9e82f2: done: 0.02689 sec","job_status":"done","queue_duration_s":2.254049,"scheduling_latency_s":2.254091,"redis_calls":13,"redis_duration_s":0.003654,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001283,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002371,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02689,"completed_at":"2026-09-04T07:29:05.770Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517gitlab # [ 291.903648] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.773Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5da3a2a1d55364d6a2eb8cf","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5da3a2a1d55364d6a2eb8cf: start","job_status":"start","queue_duration_s":2.283003,"scheduling_latency_s":2.283031}1518gitlab # [ 291.916232] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.913Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5da3a2a1d55364d6a2eb8cf","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5da3a2a1d55364d6a2eb8cf: done: 0.139922 sec","job_status":"done","queue_duration_s":2.283003,"scheduling_latency_s":2.283031,"redis_calls":13,"redis_duration_s":0.104476,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.099731,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004745,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03056,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.139922,"completed_at":"2026-09-04T07:29:05.913Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519gitlab # [ 291.956842] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0dc1ab853bb0fa7ddc5a228","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0dc1ab853bb0fa7ddc5a228: start","job_status":"start","queue_duration_s":2.426523,"scheduling_latency_s":2.426576}1520gitlab # [ 291.969410] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.957Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0dc1ab853bb0fa7ddc5a228","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0dc1ab853bb0fa7ddc5a228: done: 0.041162 sec","job_status":"done","queue_duration_s":2.426523,"scheduling_latency_s":2.426576,"redis_calls":13,"redis_duration_s":0.004332,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002797,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.041162,"completed_at":"2026-09-04T07:29:05.957Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521gitlab # [ 292.010128] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.960Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52821f2713ab2a888682c18b","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52821f2713ab2a888682c18b: start","job_status":"start","queue_duration_s":2.470438,"scheduling_latency_s":2.470478}1522gitlab # [ 292.022648] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:05.999Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52821f2713ab2a888682c18b","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52821f2713ab2a888682c18b: done: 0.039338 sec","job_status":"done","queue_duration_s":2.470438,"scheduling_latency_s":2.470478,"redis_calls":13,"redis_duration_s":0.005856,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001982,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.039338,"completed_at":"2026-09-04T07:29:05.999Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523gitlab # [ 292.061943] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.004Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2117029168e80c88045fc87","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2117029168e80c88045fc87: start","job_status":"start","queue_duration_s":2.514087,"scheduling_latency_s":2.51414}1524gitlab # [ 292.074482] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.044Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2117029168e80c88045fc87","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2117029168e80c88045fc87: done: 0.040092 sec","job_status":"done","queue_duration_s":2.514087,"scheduling_latency_s":2.51414,"redis_calls":13,"redis_duration_s":0.004718,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00158,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003138,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026898,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.040092,"completed_at":"2026-09-04T07:29:06.044Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525gitlab # [ 292.113998] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.047Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7451482677c6327c52a38e79","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7451482677c6327c52a38e79: start","job_status":"start","queue_duration_s":2.556878,"scheduling_latency_s":2.556921}1526gitlab # [ 292.126564] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.077Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7451482677c6327c52a38e79","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7451482677c6327c52a38e79: done: 0.030382 sec","job_status":"done","queue_duration_s":2.556878,"scheduling_latency_s":2.556921,"redis_calls":13,"redis_duration_s":0.004432,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001464,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019268,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030382,"completed_at":"2026-09-04T07:29:06.077Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527gitlab # [ 292.168709] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.079Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31621039b387eb891dbecbd9","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31621039b387eb891dbecbd9: start","job_status":"start","queue_duration_s":2.589594,"scheduling_latency_s":2.589635}1528gitlab # [ 292.181696] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31621039b387eb891dbecbd9","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31621039b387eb891dbecbd9: done: 0.027006 sec","job_status":"done","queue_duration_s":2.589594,"scheduling_latency_s":2.589635,"redis_calls":13,"redis_duration_s":0.003685,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001285,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027006,"completed_at":"2026-09-04T07:29:06.106Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529gitlab # [ 292.221841] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.109Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"819ce6911c9045e63a56a8b5","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-819ce6911c9045e63a56a8b5: start","job_status":"start","queue_duration_s":2.618881,"scheduling_latency_s":2.618917}1530gitlab # [ 292.234587] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.131Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"819ce6911c9045e63a56a8b5","created_at":"2026-09-04T07:29:02.632Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-19e17a075e1c4019","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1e8ce6ab3d0ce2e03ae3841281cd83a3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.490Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-819ce6911c9045e63a56a8b5: done: 0.022763 sec","job_status":"done","queue_duration_s":2.618881,"scheduling_latency_s":2.618917,"redis_calls":13,"redis_duration_s":0.0033369999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001122,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002215,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013482,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022763,"completed_at":"2026-09-04T07:29:06.131Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531gitlab # [ 292.275896] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.134Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"c4b1664114c32f81e5170d36","created_at":"2026-09-04T07:29:03.494Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"983af561a44da05cb823f1993fa6e4b6","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.509Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-c4b1664114c32f81e5170d36: start","job_status":"start","queue_duration_s":2.624348,"scheduling_latency_s":2.624379}1532gitlab # [ 292.290963] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.665Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"c4b1664114c32f81e5170d36","created_at":"2026-09-04T07:29:03.494Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"983af561a44da05cb823f1993fa6e4b6","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.509Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-c4b1664114c32f81e5170d36: done: 0.531173 sec","job_status":"done","queue_duration_s":2.624348,"scheduling_latency_s":2.624379,"redis_calls":562,"redis_duration_s":0.13571,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001419,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.134291,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.460866,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.531173,"completed_at":"2026-09-04T07:29:06.665Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533gitlab # [ 292.333600] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.667Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"6448e7118b8682804d32102f","created_at":"2026-09-04T07:29:03.550Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dd99f1318ddc67e15b284a2facf67463","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.556Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-6448e7118b8682804d32102f: start","job_status":"start","queue_duration_s":3.110629,"scheduling_latency_s":3.110665}1534gitlab # [ 292.347973] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.697Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"6448e7118b8682804d32102f","created_at":"2026-09-04T07:29:03.550Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dd99f1318ddc67e15b284a2facf67463","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.556Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-6448e7118b8682804d32102f: done: 0.029744 sec","job_status":"done","queue_duration_s":3.110629,"scheduling_latency_s":3.110665,"redis_calls":9,"redis_duration_s":0.002503,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001298,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001205,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00135646,"exclusive_lock_hold_duration_s":0.00576118,"duration_s":0.029744,"completed_at":"2026-09-04T07:29:06.697Z","load_balancing_strategy":"primary","db_duration_s":0.00152,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535gitlab # [ 292.389769] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.699Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"9ce65f502132c83b72e1b652","created_at":"2026-09-04T07:29:03.579Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"943314376622ca356f0cdcad6b38c060","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.586Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-9ce65f502132c83b72e1b652: start","job_status":"start","queue_duration_s":3.11277,"scheduling_latency_s":3.112802}1536gitlab # [ 292.404912] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.712Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1537gitlab # [ 292.408122] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.721Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"9ce65f502132c83b72e1b652","created_at":"2026-09-04T07:29:03.579Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"943314376622ca356f0cdcad6b38c060","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.586Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-9ce65f502132c83b72e1b652: done: 0.022089 sec","job_status":"done","queue_duration_s":3.11277,"scheduling_latency_s":3.112802,"redis_calls":7,"redis_duration_s":0.001838,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001317,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000521,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022089,"completed_at":"2026-09-04T07:29:06.721Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1538gitlab # [ 292.450521] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.723Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"7956c6ffc014c9c8e9a1e94d","created_at":"2026-09-04T07:29:03.597Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac335323d6d7b20cf3b0986fee599605","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:29:03.603Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-7956c6ffc014c9c8e9a1e94d: start","job_status":"start","queue_duration_s":3.120494,"scheduling_latency_s":3.120527}1539gitlab # [ 292.464867] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.736Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1540gitlab # [ 292.468267] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.745Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"7956c6ffc014c9c8e9a1e94d","created_at":"2026-09-04T07:29:03.597Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac335323d6d7b20cf3b0986fee599605","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:29:03.603Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-7956c6ffc014c9c8e9a1e94d: done: 0.021881 sec","job_status":"done","queue_duration_s":3.120494,"scheduling_latency_s":3.120527,"redis_calls":7,"redis_duration_s":0.001808,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001279,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000529,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013421,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021881,"completed_at":"2026-09-04T07:29:06.745Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541gitlab # [ 292.509942] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.747Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"9e5afbea4381123a228f486b","created_at":"2026-09-04T07:29:03.631Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2c39363ebb2a5caf17c540aa8cb060cd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:29:03.652Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-9e5afbea4381123a228f486b: start","job_status":"start","queue_duration_s":3.095227,"scheduling_latency_s":3.095258}1542gitlab # [ 292.524073] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.780Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"9e5afbea4381123a228f486b","created_at":"2026-09-04T07:29:03.631Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2c39363ebb2a5caf17c540aa8cb060cd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:29:03.652Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-9e5afbea4381123a228f486b: done: 0.033086 sec","job_status":"done","queue_duration_s":3.095227,"scheduling_latency_s":3.095258,"redis_calls":7,"redis_duration_s":0.001707,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001227,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00048,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033086,"completed_at":"2026-09-04T07:29:06.780Z","load_balancing_strategy":"primary","db_duration_s":0.00105,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543gitlab # [ 292.565640] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.782Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7a04f8f665af760960ee8e37","created_at":"2026-09-04T07:29:04.413Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-a052dc547f6a4d43","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"00e6354c1a1697c25b3d22a351030c61","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.426Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7a04f8f665af760960ee8e37: start","job_status":"start","queue_duration_s":2.355882,"scheduling_latency_s":2.35591}1544gitlab # [ 292.578595] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.797Z","message":"No existing merge request to be cleaned up."}1545gitlab # [ 292.580393] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.809Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7a04f8f665af760960ee8e37","created_at":"2026-09-04T07:29:04.413Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-a052dc547f6a4d43","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"00e6354c1a1697c25b3d22a351030c61","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.426Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7a04f8f665af760960ee8e37: done: 0.026965 sec","job_status":"done","queue_duration_s":2.355882,"scheduling_latency_s":2.35591,"redis_calls":10,"redis_duration_s":0.002296,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001344,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018856,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026965,"completed_at":"2026-09-04T07:29:06.809Z","load_balancing_strategy":"primary","db_duration_s":0.00207,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1546gitlab # [ 292.620323] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.811Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"41b115cbeef6c1f32d2b9246","created_at":"2026-09-04T07:29:04.413Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-a052dc547f6a4d43","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"00e6354c1a1697c25b3d22a351030c61","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.426Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-41b115cbeef6c1f32d2b9246: start","job_status":"start","queue_duration_s":2.384508,"scheduling_latency_s":2.384538}1547gitlab # [ 292.633304] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.825Z","message":"No existing merge request to be cleaned up."}1548gitlab # [ 292.635059] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.836Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"41b115cbeef6c1f32d2b9246","created_at":"2026-09-04T07:29:04.413Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-a052dc547f6a4d43","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"00e6354c1a1697c25b3d22a351030c61","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.426Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-41b115cbeef6c1f32d2b9246: done: 0.025923 sec","job_status":"done","queue_duration_s":2.384508,"scheduling_latency_s":2.384538,"redis_calls":10,"redis_duration_s":0.00227,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00131,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025923,"completed_at":"2026-09-04T07:29:06.836Z","load_balancing_strategy":"primary","db_duration_s":0.001962,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549gitlab # [ 292.675918] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.838Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c133982e421cf55fc0740d53","created_at":"2026-09-04T07:29:04.413Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-a052dc547f6a4d43","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"00e6354c1a1697c25b3d22a351030c61","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.426Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c133982e421cf55fc0740d53: start","job_status":"start","queue_duration_s":2.412168,"scheduling_latency_s":2.412195}1550gitlab # [ 292.688889] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.853Z","message":"No existing merge request to be cleaned up."}1551gitlab # [ 292.690593] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.864Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c133982e421cf55fc0740d53","created_at":"2026-09-04T07:29:04.413Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-a052dc547f6a4d43","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"00e6354c1a1697c25b3d22a351030c61","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.426Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c133982e421cf55fc0740d53: done: 0.026008 sec","job_status":"done","queue_duration_s":2.412168,"scheduling_latency_s":2.412195,"redis_calls":10,"redis_duration_s":0.0023870000000000002,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00098,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001407,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026008,"completed_at":"2026-09-04T07:29:06.864Z","load_balancing_strategy":"primary","db_duration_s":0.001953,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1552gitlab # [ 292.730790] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.866Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"27f8e5be5a666d41513f6245","created_at":"2026-09-04T07:29:04.413Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-a052dc547f6a4d43","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"00e6354c1a1697c25b3d22a351030c61","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.426Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-27f8e5be5a666d41513f6245: start","job_status":"start","queue_duration_s":2.439805,"scheduling_latency_s":2.439865}1553gitlab # [ 292.743767] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.881Z","message":"No existing merge request to be cleaned up."}1554gitlab # [ 292.745608] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:29:06.893Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"27f8e5be5a666d41513f6245","created_at":"2026-09-04T07:29:04.413Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-a052dc547f6a4d43","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"00e6354c1a1697c25b3d22a351030c61","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.426Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-27f8e5be5a666d41513f6245: done: 0.027369 sec","job_status":"done","queue_duration_s":2.439805,"scheduling_latency_s":2.439865,"redis_calls":10,"redis_duration_s":0.002536,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00123,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001306,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027369,"completed_at":"2026-09-04T07:29:06.893Z","load_balancing_strategy":"primary","db_duration_s":0.003606,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555gitlab # [ 310.202709] redis[790]: 10 changes in 300 seconds. Saving...1556gitlab # [ 310.208998] redis[790]: Background saving started by pid 34191557gitlab # [ 310.214231] redis[3419]: BGSAVE done, 431 keys saved, 0 keys skipped, 115600 bytes written.1558gitlab # [ 310.220178] redis[3419]: DB saved on disk1559gitlab # [ 310.222533] redis[3419]: Fork CoW for RDB: current 1 MB, peak 1 MB, average 0 MB1560gitlab # [ 310.304576] redis[790]: Background saving terminated with success1561gitlab # [ 311.911633] postgres[858]: [858] LOG: checkpoint starting: time1562gitlab # [ 312.789159] gitaly[896]: time="2026-09-04T07:29:34.673Z" level=info msg="burden monitor stats" pid=8961563gitlab # [ 316.072365] setup-gitlab-start[3224]: W, [2026-09-04T07:29:37.957139 #3224] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1564gitlab # [ 343.344154] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:05.228Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"a0b29b44cc8fcfe6c24c8012","created_at":"2026-09-04T07:30:05.147Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4ee76dba5fac44c93ffa4bf6416a1528","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:05.224Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-a0b29b44cc8fcfe6c24c8012: start","job_status":"start","queue_duration_s":0.003963,"scheduling_latency_s":0.004025}1565gitlab # [ 343.663110] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:05.545Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"a0b29b44cc8fcfe6c24c8012","created_at":"2026-09-04T07:30:05.147Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4ee76dba5fac44c93ffa4bf6416a1528","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:05.224Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-a0b29b44cc8fcfe6c24c8012: done: 0.317679 sec","job_status":"done","queue_duration_s":0.003963,"scheduling_latency_s":0.004025,"redis_calls":18,"redis_duration_s":0.031207,"redis_read_bytes":781,"redis_write_bytes":1643,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.011917,"redis_feature_flag_read_bytes":770,"redis_feature_flag_write_bytes":731,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.011042,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.008248,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":298,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.068879,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00216102,"duration_s":0.317679,"completed_at":"2026-09-04T07:30:05.545Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.06224,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1566gitlab # [ 343.760182] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:05.618Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"adbe5aab818113a2a6674e76","created_at":"2026-09-04T07:30:05.291Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:05.301Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-adbe5aab818113a2a6674e76: start","job_status":"start","queue_duration_s":0.316743,"scheduling_latency_s":0.31681}1567gitlab # [ 344.545745] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:06.429Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"adbe5aab818113a2a6674e76","created_at":"2026-09-04T07:30:05.291Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:05.301Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-adbe5aab818113a2a6674e76: done: 0.81125 sec","job_status":"done","queue_duration_s":0.316743,"scheduling_latency_s":0.31681,"redis_calls":65,"redis_duration_s":0.270632,"redis_read_bytes":748,"redis_write_bytes":41502,"redis_feature_flag_calls":5,"redis_feature_flag_duration_s":0.013287,"redis_feature_flag_read_bytes":640,"redis_feature_flag_write_bytes":393,"redis_queues_calls":2,"redis_queues_duration_s":0.00518,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.226963,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.025202,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.358324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.81125,"completed_at":"2026-09-04T07:30:06.429Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1568gitlab # [ 344.560931] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:06.446Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"d36c966e2d76c9ce2146ad40","created_at":"2026-09-04T07:30:05.333Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a0396d7002372a2f2a3e3ddfafd154a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:30:05.381Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-d36c966e2d76c9ce2146ad40: start","job_status":"start","queue_duration_s":1.064519,"scheduling_latency_s":1.064596}1569gitlab # [ 344.651456] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:06.480Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1570gitlab # [ 344.657304] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:06.538Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"d36c966e2d76c9ce2146ad40","created_at":"2026-09-04T07:30:05.333Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a0396d7002372a2f2a3e3ddfafd154a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:30:05.381Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-d36c966e2d76c9ce2146ad40: done: 0.092766 sec","job_status":"done","queue_duration_s":1.064519,"scheduling_latency_s":1.064596,"redis_calls":8,"redis_duration_s":0.018644,"redis_read_bytes":133,"redis_write_bytes":908,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000361,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":107,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.017271,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001012,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.092766,"completed_at":"2026-09-04T07:30:06.538Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1571gitlab # [ 344.711224] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:06.549Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"28fc62f79a4c487419d3788f","created_at":"2026-09-04T07:30:05.392Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6fa5e83c85b18bf7eaad6e57d041289a","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:05.404Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-28fc62f79a4c487419d3788f: start","job_status":"start","queue_duration_s":1.143703,"scheduling_latency_s":1.145219}1572gitlab # [ 344.804966] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:06.689Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"28fc62f79a4c487419d3788f","created_at":"2026-09-04T07:30:05.392Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6fa5e83c85b18bf7eaad6e57d041289a","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:05.404Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-28fc62f79a4c487419d3788f: done: 0.141933 sec","job_status":"done","queue_duration_s":1.143703,"scheduling_latency_s":1.145219,"redis_calls":12,"redis_duration_s":0.025414,"redis_read_bytes":264,"redis_write_bytes":1388,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000716,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":149,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.019971,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004727,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041871,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.04799308,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.141933,"completed_at":"2026-09-04T07:30:06.689Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.04118,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1573gitlab # [ 344.878106] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:06.710Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"3f914d3680d9a950b3726cbb","created_at":"2026-09-04T07:30:05.430Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b267740b88737d0ba5dd40c9891cdf23","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:05.440Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-3f914d3680d9a950b3726cbb: start","job_status":"start","queue_duration_s":1.269871,"scheduling_latency_s":1.269946}1574gitlab # [ 345.101850] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:06.986Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"3f914d3680d9a950b3726cbb","created_at":"2026-09-04T07:30:05.430Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b267740b88737d0ba5dd40c9891cdf23","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:05.440Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-3f914d3680d9a950b3726cbb: done: 0.275922 sec","job_status":"done","queue_duration_s":1.269871,"scheduling_latency_s":1.269946,"redis_calls":11,"redis_duration_s":0.039498000000000005,"redis_read_bytes":263,"redis_write_bytes":1334,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000857,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":172,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006902,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.031739,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.046,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.09029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0039823,"exclusive_lock_hold_duration_s":0.14022076,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.275922,"completed_at":"2026-09-04T07:30:06.986Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.114105,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1575gitlab # [ 345.195054] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.006Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"83b0c6e1782d79c12a8470e5","created_at":"2026-09-04T07:30:05.463Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a1a24f57f7a81a60c39f888ac83bfb78","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:05.496Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-83b0c6e1782d79c12a8470e5: start","job_status":"start","queue_duration_s":1.509251,"scheduling_latency_s":1.509327}1576gitlab # [ 345.299260] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.183Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"83b0c6e1782d79c12a8470e5","created_at":"2026-09-04T07:30:05.463Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a1a24f57f7a81a60c39f888ac83bfb78","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:05.496Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-83b0c6e1782d79c12a8470e5: done: 0.17781 sec","job_status":"done","queue_duration_s":1.509251,"scheduling_latency_s":1.509327,"redis_calls":10,"redis_duration_s":0.023082,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.008081,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.011991,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00301,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0017149,"duration_s":0.17781,"completed_at":"2026-09-04T07:30:07.183Z","load_balancing_strategy":"primary","db_duration_s":0.064526,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1577gitlab # [ 345.368953] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.202Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"8d71c482fef2041c86e873a0","created_at":"2026-09-04T07:30:05.527Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dff2488ac4fb87eb5e8d26ce17cf9b35","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:05.537Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-8d71c482fef2041c86e873a0: start","job_status":"start","queue_duration_s":1.665023,"scheduling_latency_s":1.665093}1578gitlab # [ 345.443431] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.328Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"8d71c482fef2041c86e873a0","created_at":"2026-09-04T07:30:05.527Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dff2488ac4fb87eb5e8d26ce17cf9b35","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:05.537Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-8d71c482fef2041c86e873a0: done: 0.125616 sec","job_status":"done","queue_duration_s":1.665023,"scheduling_latency_s":1.665093,"redis_calls":8,"redis_duration_s":0.036685999999999996,"redis_read_bytes":133,"redis_write_bytes":764,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.004531,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":83,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.028827,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003328,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038446,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.125616,"completed_at":"2026-09-04T07:30:07.328Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007864,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1579gitlab # [ 345.531701] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.342Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"9970715072dd68397409d301","created_at":"2026-09-04T07:30:05.638Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"219fb6357761c4f41c67c7716fbe9e99","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:05.657Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-9970715072dd68397409d301: start","job_status":"start","queue_duration_s":1.684034,"scheduling_latency_s":1.684099}1580gitlab # [ 345.675378] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.558Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"9970715072dd68397409d301","created_at":"2026-09-04T07:30:05.638Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"219fb6357761c4f41c67c7716fbe9e99","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:05.657Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-9970715072dd68397409d301: done: 0.216863 sec","job_status":"done","queue_duration_s":1.684034,"scheduling_latency_s":1.684099,"redis_calls":10,"redis_duration_s":0.016222,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004471,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008876,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002875,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00126516,"extra.pages_deactivate_expired_deployments_cron_worker.deactivate_expired_pages_deployments":{"deactivated_deployments":0,"duration":0.00936296},"duration_s":0.216863,"completed_at":"2026-09-04T07:30:07.558Z","load_balancing_strategy":"primary","db_duration_s":0.088622,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1581gitlab # [ 345.768282] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.563Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"da67dc6cc5aed1c297a341fa","created_at":"2026-09-04T07:30:05.671Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"833246f7dabfcfdfbbca089b0aa6b356","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:05.700Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-da67dc6cc5aed1c297a341fa: start","job_status":"start","queue_duration_s":1.862461,"scheduling_latency_s":1.862517}1582gitlab # [ 345.785452] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.620Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"da67dc6cc5aed1c297a341fa","created_at":"2026-09-04T07:30:05.671Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"833246f7dabfcfdfbbca089b0aa6b356","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:05.700Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-da67dc6cc5aed1c297a341fa: done: 0.057766 sec","job_status":"done","queue_duration_s":1.862461,"scheduling_latency_s":1.862517,"redis_calls":10,"redis_duration_s":0.0045839999999999995,"redis_read_bytes":9,"redis_write_bytes":1087,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00107,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002632,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":566,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000882,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":216,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00064366,"duration_s":0.057766,"completed_at":"2026-09-04T07:30:07.620Z","load_balancing_strategy":"primary","db_duration_s":0.001363,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1583gitlab # [ 345.828604] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.623Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"dfc78031038098b9b264c2c2","created_at":"2026-09-04T07:30:05.737Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b5491aa4d1ace2eb01d5c306cb68a7df","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:05.756Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-dfc78031038098b9b264c2c2: start","job_status":"start","queue_duration_s":1.867365,"scheduling_latency_s":1.867408}1584gitlab # [ 345.843720] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.649Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"dfc78031038098b9b264c2c2","created_at":"2026-09-04T07:30:05.737Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b5491aa4d1ace2eb01d5c306cb68a7df","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:05.756Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-dfc78031038098b9b264c2c2: done: 0.026407 sec","job_status":"done","queue_duration_s":1.867365,"scheduling_latency_s":1.867408,"redis_calls":10,"redis_duration_s":0.002875,"redis_read_bytes":389,"redis_write_bytes":1078,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000823,"redis_feature_flag_read_bytes":384,"redis_feature_flag_write_bytes":247,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001449,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000603,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015892,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026407,"completed_at":"2026-09-04T07:30:07.649Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1585gitlab # [ 345.889118] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.652Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"9d0076139b579bd95b6cd13c","created_at":"2026-09-04T07:30:05.807Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe7ac42ba4554d21596596e34adef21f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:05.847Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-9d0076139b579bd95b6cd13c: start","job_status":"start","queue_duration_s":1.804093,"scheduling_latency_s":1.804126}1586gitlab # [ 345.902491] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.694Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"9d0076139b579bd95b6cd13c","created_at":"2026-09-04T07:30:05.807Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe7ac42ba4554d21596596e34adef21f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:05.847Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-9d0076139b579bd95b6cd13c: done: 0.042087 sec","job_status":"done","queue_duration_s":1.804093,"scheduling_latency_s":1.804126,"redis_calls":11,"redis_duration_s":0.00395,"redis_read_bytes":10,"redis_write_bytes":1022,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000755,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":283,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0021,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001095,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":225,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00053608,"duration_s":0.042087,"completed_at":"2026-09-04T07:30:07.694Z","load_balancing_strategy":"primary","db_duration_s":0.00737,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1587gitlab # [ 345.944776] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.696Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::Export::PruneProjectExportJobsWorker","jid":"6fdebeac07953cde3e311209","created_at":"2026-09-04T07:30:05.879Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e6dc15949bce68a6f1c49a1c180368c","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b2f7045536fe38235224f4d98e515e25b0b0eea1aa1ae4b4ab9f99ab22c53b43","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:05.914Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::Export::PruneProjectExportJobsWorker JID-6fdebeac07953cde3e311209: start","job_status":"start","queue_duration_s":1.782424,"scheduling_latency_s":1.782459}1588gitlab # [ 345.960045] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.742Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::Export::PruneProjectExportJobsWorker","jid":"6fdebeac07953cde3e311209","created_at":"2026-09-04T07:30:05.879Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e6dc15949bce68a6f1c49a1c180368c","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b2f7045536fe38235224f4d98e515e25b0b0eea1aa1ae4b4ab9f99ab22c53b43","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:05.914Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::Export::PruneProjectExportJobsWorker JID-6fdebeac07953cde3e311209: done: 0.046186 sec","job_status":"done","queue_duration_s":1.782424,"scheduling_latency_s":1.782459,"redis_calls":10,"redis_duration_s":0.0037219999999999996,"redis_read_bytes":9,"redis_write_bytes":1173,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00079,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002211,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000721,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":236,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026158,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00049068,"duration_s":0.046186,"completed_at":"2026-09-04T07:30:07.742Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008578,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1589gitlab # [ 346.005216] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.745Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"0702be0953464d9de5d604f3","created_at":"2026-09-04T07:30:05.945Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3a204adf827daf93daa7f85a41a4c2d6","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:05.980Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-0702be0953464d9de5d604f3: start","job_status":"start","queue_duration_s":1.764628,"scheduling_latency_s":1.764662}1590gitlab # [ 346.019399] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.791Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"0702be0953464d9de5d604f3","created_at":"2026-09-04T07:30:05.945Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3a204adf827daf93daa7f85a41a4c2d6","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:05.980Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-0702be0953464d9de5d604f3: done: 0.046768 sec","job_status":"done","queue_duration_s":1.764628,"scheduling_latency_s":1.764662,"redis_calls":10,"redis_duration_s":0.004182,"redis_read_bytes":9,"redis_write_bytes":1097,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001342,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":309,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002076,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000764,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":218,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026446,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005754,"duration_s":0.046768,"completed_at":"2026-09-04T07:30:07.791Z","load_balancing_strategy":"primary","db_duration_s":0.009023,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1591gitlab # [ 346.061082] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.794Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"7f72c027c23c580dad1a23a6","created_at":"2026-09-04T07:30:06.007Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b0cf6b4cbf03f9546c15b6d137d6b785","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.029Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-7f72c027c23c580dad1a23a6: start","job_status":"start","queue_duration_s":1.764814,"scheduling_latency_s":1.764878}1592gitlab # [ 346.077076] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.834Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"7f72c027c23c580dad1a23a6","created_at":"2026-09-04T07:30:06.007Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b0cf6b4cbf03f9546c15b6d137d6b785","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.029Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-7f72c027c23c580dad1a23a6: done: 0.040566 sec","job_status":"done","queue_duration_s":1.764814,"scheduling_latency_s":1.764878,"redis_calls":11,"redis_duration_s":0.0035380000000000003,"redis_read_bytes":517,"redis_write_bytes":1011,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001368,"redis_feature_flag_read_bytes":512,"redis_feature_flag_write_bytes":300,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001598,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000572,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040566,"completed_at":"2026-09-04T07:30:07.834Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01315,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1593gitlab # [ 346.121577] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.837Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"c32656ef395080e3df0509bb","created_at":"2026-09-04T07:30:06.059Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"965bcdfd3db427b7b8358be4d0f0f63f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.079Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-c32656ef395080e3df0509bb: start","job_status":"start","queue_duration_s":1.757134,"scheduling_latency_s":1.757165}1594gitlab # [ 346.136772] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.848Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1595gitlab # [ 346.140478] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.856Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"c32656ef395080e3df0509bb","created_at":"2026-09-04T07:30:06.059Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"965bcdfd3db427b7b8358be4d0f0f63f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.079Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-c32656ef395080e3df0509bb: done: 0.019931 sec","job_status":"done","queue_duration_s":1.757134,"scheduling_latency_s":1.757165,"redis_calls":8,"redis_duration_s":0.00243,"redis_read_bytes":133,"redis_write_bytes":867,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000322,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":101,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001507,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000601,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01224,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019931,"completed_at":"2026-09-04T07:30:07.856Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1596gitlab # [ 346.183507] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.859Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"6279dd76918a81110782f463","created_at":"2026-09-04T07:30:06.109Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ada823848a2e0a83bce5712d8b5de786","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.126Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-6279dd76918a81110782f463: start","job_status":"start","queue_duration_s":1.73329,"scheduling_latency_s":1.733325}1597gitlab # [ 346.198703] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.884Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"6279dd76918a81110782f463","created_at":"2026-09-04T07:30:06.109Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ada823848a2e0a83bce5712d8b5de786","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.126Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-6279dd76918a81110782f463: done: 0.025063 sec","job_status":"done","queue_duration_s":1.73329,"scheduling_latency_s":1.733325,"redis_calls":8,"redis_duration_s":0.002598,"redis_read_bytes":133,"redis_write_bytes":888,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000264,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":102,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00171,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000624,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015374,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025063,"completed_at":"2026-09-04T07:30:07.884Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00239,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1598gitlab # [ 346.243417] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.886Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"3a6f399432f4402e191f7245","created_at":"2026-09-04T07:30:06.154Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3a4c51c0d798a013eb7a89748995f634","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.189Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-3a6f399432f4402e191f7245: start","job_status":"start","queue_duration_s":1.697067,"scheduling_latency_s":1.697098}1599gitlab # [ 346.258899] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.923Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"3a6f399432f4402e191f7245","created_at":"2026-09-04T07:30:06.154Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3a4c51c0d798a013eb7a89748995f634","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.189Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-3a6f399432f4402e191f7245: done: 0.036691 sec","job_status":"done","queue_duration_s":1.697067,"scheduling_latency_s":1.697098,"redis_calls":13,"redis_duration_s":0.00396,"redis_read_bytes":10,"redis_write_bytes":1343,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000746,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001587,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001627,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":368,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038574,"extra.packages_cleanup_delete_orphaned_dependencies_worker.last_processed_packages_dependency_id":0,"extra.packages_cleanup_delete_orphaned_dependencies_worker.deleted_rows_count":0,"duration_s":0.036691,"completed_at":"2026-09-04T07:30:07.923Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006344,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1600gitlab # [ 346.307306] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.925Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"23f2bb1b48b04b79eee13e77","created_at":"2026-09-04T07:30:06.235Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a1fa7acac516878dc4340741b9cbd36a","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.268Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-23f2bb1b48b04b79eee13e77: start","job_status":"start","queue_duration_s":1.656365,"scheduling_latency_s":1.656392}1601gitlab # [ 346.321941] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.951Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"23f2bb1b48b04b79eee13e77","created_at":"2026-09-04T07:30:06.235Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a1fa7acac516878dc4340741b9cbd36a","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.268Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-23f2bb1b48b04b79eee13e77: done: 0.026169 sec","job_status":"done","queue_duration_s":1.656365,"scheduling_latency_s":1.656392,"redis_calls":10,"redis_duration_s":0.002971,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000689,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001702,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00058,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015295,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037356,"duration_s":0.026169,"completed_at":"2026-09-04T07:30:07.951Z","load_balancing_strategy":"primary","db_duration_s":0.001894,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1602gitlab # [ 346.366293] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.953Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"44fcf17308d68b5f869ae3bc","created_at":"2026-09-04T07:30:06.298Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"73e71268d8144d5a7a71b41594005d27","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.320Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-44fcf17308d68b5f869ae3bc: start","job_status":"start","queue_duration_s":1.633347,"scheduling_latency_s":1.633375}1603gitlab # [ 346.380894] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.991Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"44fcf17308d68b5f869ae3bc","created_at":"2026-09-04T07:30:06.298Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"73e71268d8144d5a7a71b41594005d27","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.320Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-44fcf17308d68b5f869ae3bc: done: 0.038353 sec","job_status":"done","queue_duration_s":1.633347,"scheduling_latency_s":1.633375,"redis_calls":8,"redis_duration_s":0.002909,"redis_read_bytes":133,"redis_write_bytes":936,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000449,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001797,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000663,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013083,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.038353,"completed_at":"2026-09-04T07:30:07.991Z","load_balancing_strategy":"primary","db_duration_s":0.018031,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1604gitlab # [ 346.423639] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:07.994Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0077498d5f59594c1c595656","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0077498d5f59594c1c595656: start","job_status":"start","queue_duration_s":1.656226,"scheduling_latency_s":1.656258}1605gitlab # [ 346.436177] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.015Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0077498d5f59594c1c595656","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0077498d5f59594c1c595656: done: 0.021743 sec","job_status":"done","queue_duration_s":1.656226,"scheduling_latency_s":1.656258,"redis_calls":14,"redis_duration_s":0.003743,"redis_read_bytes":138,"redis_write_bytes":1242,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000258,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":85,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00113,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002355,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012875,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021743,"completed_at":"2026-09-04T07:30:08.015Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1606gitlab # [ 346.478479] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.018Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a833a9d58309404f17c185f9","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a833a9d58309404f17c185f9: start","job_status":"start","queue_duration_s":1.680047,"scheduling_latency_s":1.680078}1607gitlab # [ 346.491269] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.037Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a833a9d58309404f17c185f9","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a833a9d58309404f17c185f9: done: 0.019192 sec","job_status":"done","queue_duration_s":1.680047,"scheduling_latency_s":1.680078,"redis_calls":13,"redis_duration_s":0.003184,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002135,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011144,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019192,"completed_at":"2026-09-04T07:30:08.037Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1608gitlab # [ 346.531795] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.039Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8e760a0ba853c4961512b28","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8e760a0ba853c4961512b28: start","job_status":"start","queue_duration_s":1.701089,"scheduling_latency_s":1.701117}1609gitlab # [ 346.544720] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8e760a0ba853c4961512b28","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8e760a0ba853c4961512b28: done: 0.024277 sec","job_status":"done","queue_duration_s":1.701089,"scheduling_latency_s":1.701117,"redis_calls":13,"redis_duration_s":0.008154999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024277,"completed_at":"2026-09-04T07:30:08.063Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1610gitlab # [ 346.585910] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.065Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac637b08799b6b827fb2ab93","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac637b08799b6b827fb2ab93: start","job_status":"start","queue_duration_s":1.727317,"scheduling_latency_s":1.727346}1611gitlab # [ 346.599353] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.084Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac637b08799b6b827fb2ab93","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac637b08799b6b827fb2ab93: done: 0.019222 sec","job_status":"done","queue_duration_s":1.727317,"scheduling_latency_s":1.727346,"redis_calls":13,"redis_duration_s":0.00325,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001081,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002169,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011606,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019222,"completed_at":"2026-09-04T07:30:08.084Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1612gitlab # [ 346.641795] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.086Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43134a82486e84e6871d6430","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43134a82486e84e6871d6430: start","job_status":"start","queue_duration_s":1.748419,"scheduling_latency_s":1.748449}1613gitlab # [ 346.654994] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43134a82486e84e6871d6430","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43134a82486e84e6871d6430: done: 0.020239 sec","job_status":"done","queue_duration_s":1.748419,"scheduling_latency_s":1.748449,"redis_calls":13,"redis_duration_s":0.003314,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001117,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002197,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012051,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020239,"completed_at":"2026-09-04T07:30:08.106Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1614gitlab # [ 346.697813] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.108Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd1458c90898912c0a8ef65f","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd1458c90898912c0a8ef65f: start","job_status":"start","queue_duration_s":1.770571,"scheduling_latency_s":1.770599}1615gitlab # [ 346.710488] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.128Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd1458c90898912c0a8ef65f","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd1458c90898912c0a8ef65f: done: 0.019838 sec","job_status":"done","queue_duration_s":1.770571,"scheduling_latency_s":1.770599,"redis_calls":13,"redis_duration_s":0.003207,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001124,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002083,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012193,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019838,"completed_at":"2026-09-04T07:30:08.128Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1616gitlab # [ 346.750896] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.131Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e434a49f66da8efb0cf0ba87","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e434a49f66da8efb0cf0ba87: start","job_status":"start","queue_duration_s":1.793402,"scheduling_latency_s":1.793467}1617gitlab # [ 346.763926] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.177Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e434a49f66da8efb0cf0ba87","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e434a49f66da8efb0cf0ba87: done: 0.046726 sec","job_status":"done","queue_duration_s":1.793402,"scheduling_latency_s":1.793467,"redis_calls":13,"redis_duration_s":0.004824,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001691,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003133,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.046726,"completed_at":"2026-09-04T07:30:08.177Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1618gitlab # [ 346.805052] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.181Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03394cf03603131bbbddf55b","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03394cf03603131bbbddf55b: start","job_status":"start","queue_duration_s":1.84326,"scheduling_latency_s":1.843311}1619gitlab # [ 346.817724] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.215Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03394cf03603131bbbddf55b","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03394cf03603131bbbddf55b: done: 0.034421 sec","job_status":"done","queue_duration_s":1.84326,"scheduling_latency_s":1.843311,"redis_calls":13,"redis_duration_s":0.00342,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001228,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002192,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022778,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034421,"completed_at":"2026-09-04T07:30:08.215Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1620gitlab # [ 346.858281] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.218Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9d7e77174e69d451c19927c","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9d7e77174e69d451c19927c: start","job_status":"start","queue_duration_s":1.880123,"scheduling_latency_s":1.880452}1621gitlab # [ 346.871098] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.247Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9d7e77174e69d451c19927c","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9d7e77174e69d451c19927c: done: 0.029841 sec","job_status":"done","queue_duration_s":1.880123,"scheduling_latency_s":1.880452,"redis_calls":13,"redis_duration_s":0.003114,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001228,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001886,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01954,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029841,"completed_at":"2026-09-04T07:30:08.247Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1622gitlab # [ 346.913056] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"107e3359097ecbf4168048fa","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-107e3359097ecbf4168048fa: start","job_status":"start","queue_duration_s":1.912108,"scheduling_latency_s":1.912146}1623gitlab # [ 346.925770] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.270Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"107e3359097ecbf4168048fa","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-107e3359097ecbf4168048fa: done: 0.020937 sec","job_status":"done","queue_duration_s":1.912108,"scheduling_latency_s":1.912146,"redis_calls":13,"redis_duration_s":0.00216,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000623,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001537,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012665,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020937,"completed_at":"2026-09-04T07:30:08.270Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1624gitlab # [ 346.966781] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08b345437801664a8ec6961f","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08b345437801664a8ec6961f: start","job_status":"start","queue_duration_s":1.934479,"scheduling_latency_s":1.934509}1625gitlab # [ 346.979780] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.289Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08b345437801664a8ec6961f","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08b345437801664a8ec6961f: done: 0.016831 sec","job_status":"done","queue_duration_s":1.934479,"scheduling_latency_s":1.934509,"redis_calls":13,"redis_duration_s":0.0016089999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000605,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001004,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011064,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016831,"completed_at":"2026-09-04T07:30:08.289Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1626gitlab # [ 347.021087] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.290Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3a99b0ad9596c93245075a7","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3a99b0ad9596c93245075a7: start","job_status":"start","queue_duration_s":1.952881,"scheduling_latency_s":1.952912}1627gitlab # [ 347.034102] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.308Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3a99b0ad9596c93245075a7","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3a99b0ad9596c93245075a7: done: 0.017398 sec","job_status":"done","queue_duration_s":1.952881,"scheduling_latency_s":1.952912,"redis_calls":13,"redis_duration_s":0.001638,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000606,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011056,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017398,"completed_at":"2026-09-04T07:30:08.308Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1628gitlab # [ 347.074726] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.310Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"157b51158f33878acc9dc2b0","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-157b51158f33878acc9dc2b0: start","job_status":"start","queue_duration_s":1.972222,"scheduling_latency_s":1.97225}1629gitlab # [ 347.087667] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.327Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"157b51158f33878acc9dc2b0","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-157b51158f33878acc9dc2b0: done: 0.017614 sec","job_status":"done","queue_duration_s":1.972222,"scheduling_latency_s":1.97225,"redis_calls":13,"redis_duration_s":0.001778,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000665,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001113,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011622,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017614,"completed_at":"2026-09-04T07:30:08.327Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1630gitlab # [ 347.130125] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.329Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"233e3d1830478f3f9a14c9f7","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-233e3d1830478f3f9a14c9f7: start","job_status":"start","queue_duration_s":1.991392,"scheduling_latency_s":1.991424}1631gitlab # [ 347.143083] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.353Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"233e3d1830478f3f9a14c9f7","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-233e3d1830478f3f9a14c9f7: done: 0.023792 sec","job_status":"done","queue_duration_s":1.991392,"scheduling_latency_s":1.991424,"redis_calls":13,"redis_duration_s":0.002548,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001082,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001466,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01531,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023792,"completed_at":"2026-09-04T07:30:08.352Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1632gitlab # [ 347.183932] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.357Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e68d314282ccd0a2b336a66c","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e68d314282ccd0a2b336a66c: start","job_status":"start","queue_duration_s":2.019196,"scheduling_latency_s":2.019253}1633gitlab # [ 347.197182] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.406Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e68d314282ccd0a2b336a66c","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e68d314282ccd0a2b336a66c: done: 0.04959 sec","job_status":"done","queue_duration_s":2.019196,"scheduling_latency_s":2.019253,"redis_calls":13,"redis_duration_s":0.005959,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002101,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003858,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033649,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.04959,"completed_at":"2026-09-04T07:30:08.406Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1634gitlab # [ 347.237399] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.410Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a103d24759e19abc5fb3a18e","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a103d24759e19abc5fb3a18e: start","job_status":"start","queue_duration_s":2.072056,"scheduling_latency_s":2.072104}1635gitlab # [ 347.250056] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a103d24759e19abc5fb3a18e","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a103d24759e19abc5fb3a18e: done: 0.031017 sec","job_status":"done","queue_duration_s":2.072056,"scheduling_latency_s":2.072104,"redis_calls":13,"redis_duration_s":0.003639,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001207,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002432,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031017,"completed_at":"2026-09-04T07:30:08.440Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1636gitlab # [ 347.290119] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.443Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"415793cb8ecde26917f20dbd","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-415793cb8ecde26917f20dbd: start","job_status":"start","queue_duration_s":2.105755,"scheduling_latency_s":2.105794}1637gitlab # [ 347.304215] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"415793cb8ecde26917f20dbd","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-415793cb8ecde26917f20dbd: done: 0.02547 sec","job_status":"done","queue_duration_s":2.105755,"scheduling_latency_s":2.105794,"redis_calls":13,"redis_duration_s":0.004102,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001996,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02547,"completed_at":"2026-09-04T07:30:08.469Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1638gitlab # [ 347.344575] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.471Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c257913c74d99b58e91118ea","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c257913c74d99b58e91118ea: start","job_status":"start","queue_duration_s":2.133539,"scheduling_latency_s":2.133574}1639gitlab # [ 347.357371] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.494Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c257913c74d99b58e91118ea","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c257913c74d99b58e91118ea: done: 0.022642 sec","job_status":"done","queue_duration_s":2.133539,"scheduling_latency_s":2.133574,"redis_calls":13,"redis_duration_s":0.002532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000904,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001628,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014794,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022642,"completed_at":"2026-09-04T07:30:08.493Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1640gitlab # [ 347.396911] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.496Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72bb98ba877aa651f13239d6","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72bb98ba877aa651f13239d6: start","job_status":"start","queue_duration_s":2.15818,"scheduling_latency_s":2.158215}1641gitlab # [ 347.410041] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.518Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72bb98ba877aa651f13239d6","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72bb98ba877aa651f13239d6: done: 0.022757 sec","job_status":"done","queue_duration_s":2.15818,"scheduling_latency_s":2.158215,"redis_calls":13,"redis_duration_s":0.0023899999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000846,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001544,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022757,"completed_at":"2026-09-04T07:30:08.518Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1642gitlab # [ 347.451322] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.520Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74dee3ccf185acf6c7b7d56f","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74dee3ccf185acf6c7b7d56f: start","job_status":"start","queue_duration_s":2.182663,"scheduling_latency_s":2.182695}1643gitlab # [ 347.464346] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.541Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74dee3ccf185acf6c7b7d56f","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74dee3ccf185acf6c7b7d56f: done: 0.020603 sec","job_status":"done","queue_duration_s":2.182663,"scheduling_latency_s":2.182695,"redis_calls":13,"redis_duration_s":0.002078,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000709,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001369,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020603,"completed_at":"2026-09-04T07:30:08.541Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1644gitlab # [ 347.506024] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.542Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"349c9dfb1578bef432476099","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-349c9dfb1578bef432476099: start","job_status":"start","queue_duration_s":2.204908,"scheduling_latency_s":2.20494}1645gitlab # [ 347.519089] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.561Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"349c9dfb1578bef432476099","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-349c9dfb1578bef432476099: done: 0.019101 sec","job_status":"done","queue_duration_s":2.204908,"scheduling_latency_s":2.20494,"redis_calls":13,"redis_duration_s":0.002011,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000751,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00126,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012474,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019101,"completed_at":"2026-09-04T07:30:08.561Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1646gitlab # [ 347.560395] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.563Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9756a7a1dfcfe90d737c944a","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9756a7a1dfcfe90d737c944a: start","job_status":"start","queue_duration_s":2.22567,"scheduling_latency_s":2.225705}1647gitlab # [ 347.573129] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.601Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9756a7a1dfcfe90d737c944a","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9756a7a1dfcfe90d737c944a: done: 0.038148 sec","job_status":"done","queue_duration_s":2.22567,"scheduling_latency_s":2.225705,"redis_calls":13,"redis_duration_s":0.002354,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000956,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001398,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038148,"completed_at":"2026-09-04T07:30:08.601Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1648gitlab # [ 347.613772] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.603Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce1b35c5bb5f2aed544bead4","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce1b35c5bb5f2aed544bead4: start","job_status":"start","queue_duration_s":2.265585,"scheduling_latency_s":2.26562}1649gitlab # [ 347.626817] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.622Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce1b35c5bb5f2aed544bead4","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce1b35c5bb5f2aed544bead4: done: 0.01929 sec","job_status":"done","queue_duration_s":2.265585,"scheduling_latency_s":2.26562,"redis_calls":13,"redis_duration_s":0.002078,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000772,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001306,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012343,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01929,"completed_at":"2026-09-04T07:30:08.622Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1650gitlab # [ 347.667541] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.624Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b1cdee65b6de1dc094d2a25","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b1cdee65b6de1dc094d2a25: start","job_status":"start","queue_duration_s":2.286586,"scheduling_latency_s":2.286618}1651gitlab # [ 347.680780] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.643Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b1cdee65b6de1dc094d2a25","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b1cdee65b6de1dc094d2a25: done: 0.019247 sec","job_status":"done","queue_duration_s":2.286586,"scheduling_latency_s":2.286618,"redis_calls":13,"redis_duration_s":0.002154,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000816,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001338,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01233,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019247,"completed_at":"2026-09-04T07:30:08.643Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1652gitlab # [ 347.723635] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.645Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87ca3c9dd66b60d5a87178ae","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87ca3c9dd66b60d5a87178ae: start","job_status":"start","queue_duration_s":2.307519,"scheduling_latency_s":2.307553}1653gitlab # [ 347.736829] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.664Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87ca3c9dd66b60d5a87178ae","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87ca3c9dd66b60d5a87178ae: done: 0.019092 sec","job_status":"done","queue_duration_s":2.307519,"scheduling_latency_s":2.307553,"redis_calls":13,"redis_duration_s":0.002131,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000784,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001347,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01213,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019092,"completed_at":"2026-09-04T07:30:08.664Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1654gitlab # [ 347.777447] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.666Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca50925e9de0bd46faac1eb8","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca50925e9de0bd46faac1eb8: start","job_status":"start","queue_duration_s":2.328694,"scheduling_latency_s":2.328728}1655gitlab # [ 347.790404] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.685Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca50925e9de0bd46faac1eb8","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca50925e9de0bd46faac1eb8: done: 0.019155 sec","job_status":"done","queue_duration_s":2.328694,"scheduling_latency_s":2.328728,"redis_calls":13,"redis_duration_s":0.002129,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000816,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001313,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012169,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019155,"completed_at":"2026-09-04T07:30:08.685Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1656gitlab # [ 347.831519] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4536fe3a44d3198f907087a6","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4536fe3a44d3198f907087a6: start","job_status":"start","queue_duration_s":2.349526,"scheduling_latency_s":2.349557}1657gitlab # [ 347.844698] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.704Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4536fe3a44d3198f907087a6","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4536fe3a44d3198f907087a6: done: 0.017364 sec","job_status":"done","queue_duration_s":2.349526,"scheduling_latency_s":2.349557,"redis_calls":13,"redis_duration_s":0.0016,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000557,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001043,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017364,"completed_at":"2026-09-04T07:30:08.704Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1658gitlab # [ 347.886205] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.706Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1aa3219a826bae7a71f16de","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1aa3219a826bae7a71f16de: start","job_status":"start","queue_duration_s":2.368314,"scheduling_latency_s":2.368344}1659gitlab # [ 347.899534] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.722Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1aa3219a826bae7a71f16de","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1aa3219a826bae7a71f16de: done: 0.016434 sec","job_status":"done","queue_duration_s":2.368314,"scheduling_latency_s":2.368344,"redis_calls":13,"redis_duration_s":0.001535,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016434,"completed_at":"2026-09-04T07:30:08.722Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1660gitlab # [ 347.941814] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.724Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef0fb4f05c86f762a80f8aa6","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef0fb4f05c86f762a80f8aa6: start","job_status":"start","queue_duration_s":2.386219,"scheduling_latency_s":2.38625}1661gitlab # [ 347.954998] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef0fb4f05c86f762a80f8aa6","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef0fb4f05c86f762a80f8aa6: done: 0.016912 sec","job_status":"done","queue_duration_s":2.386219,"scheduling_latency_s":2.38625,"redis_calls":13,"redis_duration_s":0.0016640000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000608,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001056,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016912,"completed_at":"2026-09-04T07:30:08.740Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1662gitlab # [ 347.996997] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.742Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0a0abeb756d643b536c7bf4","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0a0abeb756d643b536c7bf4: start","job_status":"start","queue_duration_s":2.404663,"scheduling_latency_s":2.404694}1663gitlab # [ 348.009921] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.759Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0a0abeb756d643b536c7bf4","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0a0abeb756d643b536c7bf4: done: 0.017142 sec","job_status":"done","queue_duration_s":2.404663,"scheduling_latency_s":2.404694,"redis_calls":13,"redis_duration_s":0.001735,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000626,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01115,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017142,"completed_at":"2026-09-04T07:30:08.759Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1664gitlab # [ 348.050703] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.761Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e10a9ae976bd3e6dbec7f5b","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e10a9ae976bd3e6dbec7f5b: start","job_status":"start","queue_duration_s":2.423322,"scheduling_latency_s":2.423354}1665gitlab # [ 348.063458] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.779Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e10a9ae976bd3e6dbec7f5b","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e10a9ae976bd3e6dbec7f5b: done: 0.017908 sec","job_status":"done","queue_duration_s":2.423322,"scheduling_latency_s":2.423354,"redis_calls":13,"redis_duration_s":0.002115,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000651,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001464,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011469,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017908,"completed_at":"2026-09-04T07:30:08.779Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1666gitlab # [ 348.103818] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6340c15354b25290d2f6023b","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6340c15354b25290d2f6023b: start","job_status":"start","queue_duration_s":2.442791,"scheduling_latency_s":2.442826}1667gitlab # [ 348.118303] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6340c15354b25290d2f6023b","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6340c15354b25290d2f6023b: done: 0.017848 sec","job_status":"done","queue_duration_s":2.442791,"scheduling_latency_s":2.442826,"redis_calls":13,"redis_duration_s":0.001913,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000706,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001207,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011547,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017848,"completed_at":"2026-09-04T07:30:08.798Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1668gitlab # [ 348.160733] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1487b673dcf96c66d92f672c","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1487b673dcf96c66d92f672c: start","job_status":"start","queue_duration_s":2.462204,"scheduling_latency_s":2.462235}1669gitlab # [ 348.173647] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.818Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1487b673dcf96c66d92f672c","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1487b673dcf96c66d92f672c: done: 0.018145 sec","job_status":"done","queue_duration_s":2.462204,"scheduling_latency_s":2.462235,"redis_calls":13,"redis_duration_s":0.001882,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000685,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001197,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011856,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018145,"completed_at":"2026-09-04T07:30:08.818Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1670gitlab # [ 348.215666] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.820Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"183f05f9b08565d49eda81f5","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-183f05f9b08565d49eda81f5: start","job_status":"start","queue_duration_s":2.482145,"scheduling_latency_s":2.48218}1671gitlab # [ 348.228620] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.838Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"183f05f9b08565d49eda81f5","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-183f05f9b08565d49eda81f5: done: 0.018744 sec","job_status":"done","queue_duration_s":2.482145,"scheduling_latency_s":2.48218,"redis_calls":13,"redis_duration_s":0.001941,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000705,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001236,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018744,"completed_at":"2026-09-04T07:30:08.838Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1672gitlab # [ 348.268949] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.840Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9dccbd8e674e83a7a49049ed","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9dccbd8e674e83a7a49049ed: start","job_status":"start","queue_duration_s":2.502552,"scheduling_latency_s":2.502586}1673gitlab # [ 348.281892] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.859Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9dccbd8e674e83a7a49049ed","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9dccbd8e674e83a7a49049ed: done: 0.01895 sec","job_status":"done","queue_duration_s":2.502552,"scheduling_latency_s":2.502586,"redis_calls":13,"redis_duration_s":0.001982,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000715,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001267,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01228,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01895,"completed_at":"2026-09-04T07:30:08.859Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1674gitlab # [ 348.324046] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.863Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3113d23f2a8f492934a7f61f","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3113d23f2a8f492934a7f61f: start","job_status":"start","queue_duration_s":2.525053,"scheduling_latency_s":2.525116}1675gitlab # [ 348.337021] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.911Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3113d23f2a8f492934a7f61f","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3113d23f2a8f492934a7f61f: done: 0.048952 sec","job_status":"done","queue_duration_s":2.525053,"scheduling_latency_s":2.525116,"redis_calls":13,"redis_duration_s":0.004835,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001482,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003353,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032569,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.048952,"completed_at":"2026-09-04T07:30:08.911Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1676gitlab # [ 348.378526] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ce60f2fb98cb546da246a10","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ce60f2fb98cb546da246a10: start","job_status":"start","queue_duration_s":2.578223,"scheduling_latency_s":2.578284}1677gitlab # [ 348.391623] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.958Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ce60f2fb98cb546da246a10","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ce60f2fb98cb546da246a10: done: 0.042076 sec","job_status":"done","queue_duration_s":2.578223,"scheduling_latency_s":2.578284,"redis_calls":13,"redis_duration_s":0.004843,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001583,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00326,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027561,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.042076,"completed_at":"2026-09-04T07:30:08.957Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1678gitlab # [ 348.432926] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.961Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf189f991ac2e9f86bf34332","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf189f991ac2e9f86bf34332: start","job_status":"start","queue_duration_s":2.623124,"scheduling_latency_s":2.623168}1679gitlab # [ 348.445983] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:08.998Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf189f991ac2e9f86bf34332","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf189f991ac2e9f86bf34332: done: 0.037604 sec","job_status":"done","queue_duration_s":2.623124,"scheduling_latency_s":2.623168,"redis_calls":13,"redis_duration_s":0.004767,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001644,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003123,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023878,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.037604,"completed_at":"2026-09-04T07:30:08.998Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1680gitlab # [ 348.486376] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5c048590c09a503366ddcfc","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5c048590c09a503366ddcfc: start","job_status":"start","queue_duration_s":2.663653,"scheduling_latency_s":2.663695}1681gitlab # [ 348.498976] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.036Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5c048590c09a503366ddcfc","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5c048590c09a503366ddcfc: done: 0.034601 sec","job_status":"done","queue_duration_s":2.663653,"scheduling_latency_s":2.663695,"redis_calls":13,"redis_duration_s":0.004071,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001665,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002406,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034601,"completed_at":"2026-09-04T07:30:09.036Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1682gitlab # [ 348.540002] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.038Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"487b63794a858ad3f91ecbed","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-487b63794a858ad3f91ecbed: start","job_status":"start","queue_duration_s":2.700625,"scheduling_latency_s":2.700674}1683gitlab # [ 348.552587] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.065Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"487b63794a858ad3f91ecbed","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-487b63794a858ad3f91ecbed: done: 0.027278 sec","job_status":"done","queue_duration_s":2.700625,"scheduling_latency_s":2.700674,"redis_calls":13,"redis_duration_s":0.003527,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001317,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00221,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01741,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027278,"completed_at":"2026-09-04T07:30:09.065Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1684gitlab # [ 348.592745] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"012dab405c56f34875cdb3bb","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-012dab405c56f34875cdb3bb: start","job_status":"start","queue_duration_s":2.730914,"scheduling_latency_s":2.730953}1685gitlab # [ 348.605160] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.097Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"012dab405c56f34875cdb3bb","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-012dab405c56f34875cdb3bb: done: 0.028507 sec","job_status":"done","queue_duration_s":2.730914,"scheduling_latency_s":2.730953,"redis_calls":13,"redis_duration_s":0.0041849999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001264,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028507,"completed_at":"2026-09-04T07:30:09.097Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1686gitlab # [ 348.644978] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.099Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa1d7468f88afe605ca0522f","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa1d7468f88afe605ca0522f: start","job_status":"start","queue_duration_s":2.761565,"scheduling_latency_s":2.761602}1687gitlab # [ 348.657521] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.128Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa1d7468f88afe605ca0522f","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa1d7468f88afe605ca0522f: done: 0.029337 sec","job_status":"done","queue_duration_s":2.761565,"scheduling_latency_s":2.761602,"redis_calls":13,"redis_duration_s":0.00437,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002875,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029337,"completed_at":"2026-09-04T07:30:09.128Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1688gitlab # [ 348.697487] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.131Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"527d9c02ba026617181eccbb","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-527d9c02ba026617181eccbb: start","job_status":"start","queue_duration_s":2.793157,"scheduling_latency_s":2.793191}1689gitlab # [ 348.709087] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.157Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"527d9c02ba026617181eccbb","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-527d9c02ba026617181eccbb: done: 0.026121 sec","job_status":"done","queue_duration_s":2.793157,"scheduling_latency_s":2.793191,"redis_calls":13,"redis_duration_s":0.0037879999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001221,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002567,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016683,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026121,"completed_at":"2026-09-04T07:30:09.157Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1690gitlab # [ 348.750712] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.159Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"acea64736acb9a2b9d1e5887","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-acea64736acb9a2b9d1e5887: start","job_status":"start","queue_duration_s":2.82144,"scheduling_latency_s":2.821469}1691gitlab # [ 348.769003] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.180Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"acea64736acb9a2b9d1e5887","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-acea64736acb9a2b9d1e5887: done: 0.021542 sec","job_status":"done","queue_duration_s":2.82144,"scheduling_latency_s":2.821469,"redis_calls":13,"redis_duration_s":0.0033169999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0012,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002117,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01307,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021542,"completed_at":"2026-09-04T07:30:09.180Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1692gitlab # [ 348.810077] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.184Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c662c8dd2d0c24e187965653","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c662c8dd2d0c24e187965653: start","job_status":"start","queue_duration_s":2.846379,"scheduling_latency_s":2.846439}1693gitlab # [ 348.825748] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.234Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c662c8dd2d0c24e187965653","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c662c8dd2d0c24e187965653: done: 0.05019 sec","job_status":"done","queue_duration_s":2.846379,"scheduling_latency_s":2.846439,"redis_calls":13,"redis_duration_s":0.004707,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001688,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.05019,"completed_at":"2026-09-04T07:30:09.234Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1694gitlab # [ 348.866260] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.237Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f333ed6f5beb2f830d0c772","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f333ed6f5beb2f830d0c772: start","job_status":"start","queue_duration_s":2.899518,"scheduling_latency_s":2.899566}1695gitlab # [ 348.879537] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.270Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f333ed6f5beb2f830d0c772","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f333ed6f5beb2f830d0c772: done: 0.032885 sec","job_status":"done","queue_duration_s":2.899518,"scheduling_latency_s":2.899566,"redis_calls":13,"redis_duration_s":0.003306,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001172,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002134,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021573,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032885,"completed_at":"2026-09-04T07:30:09.270Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1696gitlab # [ 348.921958] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd3905b5dbd254fdcc3943f5","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd3905b5dbd254fdcc3943f5: start","job_status":"start","queue_duration_s":2.935177,"scheduling_latency_s":2.935218}1697gitlab # [ 348.936590] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd3905b5dbd254fdcc3943f5","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd3905b5dbd254fdcc3943f5: done: 0.027383 sec","job_status":"done","queue_duration_s":2.935177,"scheduling_latency_s":2.935218,"redis_calls":13,"redis_duration_s":0.00277,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001035,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001735,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018043,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027383,"completed_at":"2026-09-04T07:30:09.300Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1698gitlab # [ 348.976881] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.302Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aaaa31335da7dfcafc2cf17b","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aaaa31335da7dfcafc2cf17b: start","job_status":"start","queue_duration_s":2.96459,"scheduling_latency_s":2.96463}1699gitlab # [ 348.989832] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.328Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aaaa31335da7dfcafc2cf17b","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aaaa31335da7dfcafc2cf17b: done: 0.025783 sec","job_status":"done","queue_duration_s":2.96459,"scheduling_latency_s":2.96463,"redis_calls":13,"redis_duration_s":0.002602,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000994,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001608,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025783,"completed_at":"2026-09-04T07:30:09.328Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1700gitlab # [ 349.030309] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.330Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3f23b54db3779c7da30ae42","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3f23b54db3779c7da30ae42: start","job_status":"start","queue_duration_s":2.992455,"scheduling_latency_s":2.992495}1701gitlab # [ 349.043101] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.356Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3f23b54db3779c7da30ae42","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3f23b54db3779c7da30ae42: done: 0.025697 sec","job_status":"done","queue_duration_s":2.992455,"scheduling_latency_s":2.992495,"redis_calls":13,"redis_duration_s":0.002513,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000964,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001549,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025697,"completed_at":"2026-09-04T07:30:09.355Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1702gitlab # [ 349.083309] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.358Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd972c8c4350bb0ebf0f0c46","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd972c8c4350bb0ebf0f0c46: start","job_status":"start","queue_duration_s":3.020113,"scheduling_latency_s":3.02015}1703gitlab # [ 349.096191] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.383Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd972c8c4350bb0ebf0f0c46","created_at":"2026-09-04T07:30:05.753Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-d713dc31b1de44d3","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80ca878d0f689c91b2528cecc7ef7fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd972c8c4350bb0ebf0f0c46: done: 0.024998 sec","job_status":"done","queue_duration_s":3.020113,"scheduling_latency_s":3.02015,"redis_calls":13,"redis_duration_s":0.002848,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001023,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001825,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024998,"completed_at":"2026-09-04T07:30:09.382Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1704gitlab # [ 349.137555] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.385Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"9febe4ba75caaa84c088e143","created_at":"2026-09-04T07:30:06.353Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"896bdb69c84cb342177e9a083b51d2e7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.368Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-9febe4ba75caaa84c088e143: start","job_status":"start","queue_duration_s":3.016443,"scheduling_latency_s":3.016483}1705gitlab # [ 349.151895] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.769Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"9febe4ba75caaa84c088e143","created_at":"2026-09-04T07:30:06.353Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"896bdb69c84cb342177e9a083b51d2e7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.368Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-9febe4ba75caaa84c088e143: done: 0.384461 sec","job_status":"done","queue_duration_s":3.016443,"scheduling_latency_s":3.016483,"redis_calls":11,"redis_duration_s":0.0028,"redis_read_bytes":263,"redis_write_bytes":1140,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000439,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":153,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001188,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001173,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.066,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":129,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.066,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.299398,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00085244,"exclusive_lock_hold_duration_s":0.35889134,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.384461,"completed_at":"2026-09-04T07:30:09.769Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.100751,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1706gitlab # [ 349.197166] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.771Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"b8fd9abdea5d9e53e778d23a","created_at":"2026-09-04T07:30:06.404Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c86a8917606db509f1c514b51e55c21","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.440Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-b8fd9abdea5d9e53e778d23a: start","job_status":"start","queue_duration_s":3.330868,"scheduling_latency_s":3.330905}1707gitlab # [ 349.211580] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.822Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"b8fd9abdea5d9e53e778d23a","created_at":"2026-09-04T07:30:06.404Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c86a8917606db509f1c514b51e55c21","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.440Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-b8fd9abdea5d9e53e778d23a: done: 0.050963 sec","job_status":"done","queue_duration_s":3.330868,"scheduling_latency_s":3.330905,"redis_calls":20,"redis_duration_s":0.00474,"redis_read_bytes":23,"redis_write_bytes":4316,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.00148,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1065,"redis_queues_calls":4,"redis_queues_duration_s":0.000901,"redis_queues_read_bytes":6,"redis_queues_write_bytes":2021,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.001873,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":1004,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000486,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03808,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039726,"duration_s":0.050963,"completed_at":"2026-09-04T07:30:09.822Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001989,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1708gitlab # [ 349.256453] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.824Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"9bd61a0915a1b2ae1e03cc61","created_at":"2026-09-04T07:30:06.484Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c841de956b97410426e6be3d6e37e07d","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.498Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-9bd61a0915a1b2ae1e03cc61: start","job_status":"start","queue_duration_s":3.326221,"scheduling_latency_s":3.326256}1709gitlab # [ 349.270844] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.851Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"9bd61a0915a1b2ae1e03cc61","created_at":"2026-09-04T07:30:06.484Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c841de956b97410426e6be3d6e37e07d","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.498Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-9bd61a0915a1b2ae1e03cc61: done: 0.026775 sec","job_status":"done","queue_duration_s":3.326221,"scheduling_latency_s":3.326256,"redis_calls":10,"redis_duration_s":0.00249,"redis_read_bytes":135,"redis_write_bytes":1184,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000195,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":97,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001159,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001136,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017365,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00076668,"exclusive_lock_hold_duration_s":0.00446628,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.026775,"completed_at":"2026-09-04T07:30:09.851Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00142,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1710gitlab # [ 349.314002] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.853Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"9374ca40c285e3dece0eb699","created_at":"2026-09-04T07:30:06.507Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"28b69e6252cde88ad3ddb15b6c09d82e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.515Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-9374ca40c285e3dece0eb699: start","job_status":"start","queue_duration_s":3.337431,"scheduling_latency_s":3.337466}1711gitlab # [ 349.328634] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.873Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"9374ca40c285e3dece0eb699","created_at":"2026-09-04T07:30:06.507Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"28b69e6252cde88ad3ddb15b6c09d82e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.515Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-9374ca40c285e3dece0eb699: done: 0.020233 sec","job_status":"done","queue_duration_s":3.337431,"scheduling_latency_s":3.337466,"redis_calls":8,"redis_duration_s":0.001722,"redis_read_bytes":133,"redis_write_bytes":879,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000212,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":103,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001069,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000441,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012729,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020233,"completed_at":"2026-09-04T07:30:09.873Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1712gitlab # [ 349.373737] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.875Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"e0c3c5b55c986a9500ede0f6","created_at":"2026-09-04T07:30:06.524Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4828e4f396f5f51d588454d7ae716a9a","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.553Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-e0c3c5b55c986a9500ede0f6: start","job_status":"start","queue_duration_s":3.321874,"scheduling_latency_s":3.32191}1713gitlab # [ 349.387843] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.905Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"e0c3c5b55c986a9500ede0f6","created_at":"2026-09-04T07:30:06.524Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4828e4f396f5f51d588454d7ae716a9a","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.553Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-e0c3c5b55c986a9500ede0f6: done: 0.030491 sec","job_status":"done","queue_duration_s":3.321874,"scheduling_latency_s":3.32191,"redis_calls":10,"redis_duration_s":0.002189,"redis_read_bytes":9,"redis_write_bytes":1179,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000487,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001225,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000477,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":238,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020071,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036186,"duration_s":0.030491,"completed_at":"2026-09-04T07:30:09.905Z","load_balancing_strategy":"primary","db_duration_s":0.000679,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1714gitlab # [ 349.431958] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.907Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","jid":"23af62e34c4e4d0fddc65119","created_at":"2026-09-04T07:30:06.623Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6529a5d746cf7501618e05526b34ea3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6fd978bae1387dafc89025ea66dbcf41624e32b5e06562317011e023b1327155","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.650Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleBulkDeleteJobArtifactCronWorker JID-23af62e34c4e4d0fddc65119: start","job_status":"start","queue_duration_s":3.257019,"scheduling_latency_s":3.257052}1715gitlab # [ 349.447440] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.956Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","jid":"23af62e34c4e4d0fddc65119","created_at":"2026-09-04T07:30:06.623Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6529a5d746cf7501618e05526b34ea3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6fd978bae1387dafc89025ea66dbcf41624e32b5e06562317011e023b1327155","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.650Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleBulkDeleteJobArtifactCronWorker JID-23af62e34c4e4d0fddc65119: done: 0.049094 sec","job_status":"done","queue_duration_s":3.257019,"scheduling_latency_s":3.257052,"redis_calls":24,"redis_duration_s":0.005042,"redis_read_bytes":25,"redis_write_bytes":5977,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00106,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":704,"redis_queues_calls":2,"redis_queues_duration_s":0.000339,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3810,"redis_queues_metadata_calls":11,"redis_queues_metadata_duration_s":0.002428,"redis_queues_metadata_read_bytes":14,"redis_queues_metadata_write_bytes":894,"redis_shared_state_calls":7,"redis_shared_state_duration_s":0.001215,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":569,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037462,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.max_buckets":5,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.available_count":0,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.occupied_count":0,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.stale_count":0,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.missing_count":5,"duration_s":0.049094,"completed_at":"2026-09-04T07:30:09.956Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001301,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1716gitlab # [ 349.498031] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.958Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"548499a07474deac7dd32ae0","created_at":"2026-09-04T07:30:06.673Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f7f89e1739f690803804881982d227f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.686Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-548499a07474deac7dd32ae0: start","job_status":"start","queue_duration_s":3.272108,"scheduling_latency_s":3.272142}1717gitlab # [ 349.513633] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.970Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1718gitlab # [ 349.517231] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.977Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"548499a07474deac7dd32ae0","created_at":"2026-09-04T07:30:06.673Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f7f89e1739f690803804881982d227f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.686Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-548499a07474deac7dd32ae0: done: 0.01936 sec","job_status":"done","queue_duration_s":3.272108,"scheduling_latency_s":3.272142,"redis_calls":8,"redis_duration_s":0.00167,"redis_read_bytes":133,"redis_write_bytes":937,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000188,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":111,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001044,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000438,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012233,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01936,"completed_at":"2026-09-04T07:30:09.977Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1719gitlab # [ 349.562624] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:09.980Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"77404d555a89deb086deea67","created_at":"2026-09-04T07:30:06.712Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"039ec7a7db6d7d6a5ff841277ae7c075","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.733Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-77404d555a89deb086deea67: start","job_status":"start","queue_duration_s":3.24684,"scheduling_latency_s":3.246877}1720gitlab # [ 349.577849] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:10.008Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"77404d555a89deb086deea67","created_at":"2026-09-04T07:30:06.712Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"039ec7a7db6d7d6a5ff841277ae7c075","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.733Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-77404d555a89deb086deea67: done: 0.028123 sec","job_status":"done","queue_duration_s":3.24684,"scheduling_latency_s":3.246877,"redis_calls":11,"redis_duration_s":0.002498,"redis_read_bytes":9,"redis_write_bytes":1174,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000454,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00115,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00039,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000504,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017941,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034296,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.028123,"completed_at":"2026-09-04T07:30:10.008Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000649,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1721gitlab # [ 349.624736] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:10.010Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"32e7a56b05d764e822fb3606","created_at":"2026-09-04T07:30:06.777Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8afde09caf1870266868e1ea55967490","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.796Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-32e7a56b05d764e822fb3606: start","job_status":"start","queue_duration_s":3.21449,"scheduling_latency_s":3.214525}1722gitlab # [ 349.638813] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:10.031Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"32e7a56b05d764e822fb3606","created_at":"2026-09-04T07:30:06.777Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8afde09caf1870266868e1ea55967490","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.796Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-32e7a56b05d764e822fb3606: done: 0.021104 sec","job_status":"done","queue_duration_s":3.21449,"scheduling_latency_s":3.214525,"redis_calls":11,"redis_duration_s":0.002272,"redis_read_bytes":138,"redis_write_bytes":877,"redis_cache_calls":3,"redis_cache_duration_s":0.000478,"redis_cache_read_bytes":5,"redis_cache_write_bytes":97,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000194,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":84,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00114,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":482,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00046,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":214,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013497,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021104,"completed_at":"2026-09-04T07:30:10.031Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1723gitlab # [ 349.683353] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:10.033Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckExportJobsWorker","jid":"e7f0ffe383a1f7b19e92fba1","created_at":"2026-09-04T07:30:06.807Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1d0f97a68d800e6c3c923bd4a84ca5c2","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:c05136a1912f23c3950f9f6243170d655fcc26d1e5b96896d7e248d72f9039fe","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.828Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckExportJobsWorker JID-e7f0ffe383a1f7b19e92fba1: start","job_status":"start","queue_duration_s":3.204655,"scheduling_latency_s":3.204693}1724gitlab # [ 349.697438] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:10.064Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckExportJobsWorker","jid":"e7f0ffe383a1f7b19e92fba1","created_at":"2026-09-04T07:30:06.807Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1d0f97a68d800e6c3c923bd4a84ca5c2","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:c05136a1912f23c3950f9f6243170d655fcc26d1e5b96896d7e248d72f9039fe","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.828Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckExportJobsWorker JID-e7f0ffe383a1f7b19e92fba1: done: 0.030969 sec","job_status":"done","queue_duration_s":3.204655,"scheduling_latency_s":3.204693,"redis_calls":10,"redis_duration_s":0.0023,"redis_read_bytes":9,"redis_write_bytes":995,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000468,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001359,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":518,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000473,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":192,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019606,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034528,"duration_s":0.030969,"completed_at":"2026-09-04T07:30:10.064Z","load_balancing_strategy":"primary","db_duration_s":0.001566,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1725gitlab # [ 349.740772] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:10.066Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"5d41c0b27a7edb2586beab74","created_at":"2026-09-04T07:30:06.848Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5a7f231ad44ef7ba4606eef067b8af1b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.860Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-5d41c0b27a7edb2586beab74: start","job_status":"start","queue_duration_s":3.20629,"scheduling_latency_s":3.206327}1726gitlab # [ 349.756697] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:10.110Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"5d41c0b27a7edb2586beab74","created_at":"2026-09-04T07:30:06.848Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5a7f231ad44ef7ba4606eef067b8af1b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.860Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-5d41c0b27a7edb2586beab74: done: 0.044262 sec","job_status":"done","queue_duration_s":3.20629,"scheduling_latency_s":3.206327,"redis_calls":16,"redis_duration_s":0.004163,"redis_read_bytes":272,"redis_write_bytes":4225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000474,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":199,"redis_queues_calls":2,"redis_queues_duration_s":0.000391,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002476,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000822,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033771,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044262,"completed_at":"2026-09-04T07:30:10.110Z","load_balancing_strategy":"primary","db_duration_s":0.001672,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1727gitlab # [ 349.801554] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:10.112Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"38ca061692bd26a9bc2823cd","created_at":"2026-09-04T07:30:06.881Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a7e9c4993304dc3e009f608fbcd0209","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.895Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-38ca061692bd26a9bc2823cd: start","job_status":"start","queue_duration_s":3.21708,"scheduling_latency_s":3.217119}1728gitlab # [ 349.817856] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:10.125Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1729gitlab # [ 349.827414] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:10.134Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"38ca061692bd26a9bc2823cd","created_at":"2026-09-04T07:30:06.881Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a7e9c4993304dc3e009f608fbcd0209","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.895Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-38ca061692bd26a9bc2823cd: done: 0.021683 sec","job_status":"done","queue_duration_s":3.21708,"scheduling_latency_s":3.217119,"redis_calls":8,"redis_duration_s":0.001967,"redis_read_bytes":133,"redis_write_bytes":931,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000211,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001264,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000492,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013631,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021683,"completed_at":"2026-09-04T07:30:10.134Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1730gitlab # [ 349.872388] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:10.136Z","retry":0,"queue":"default","version":1,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::MonitorLockedTablesWorker","jid":"bdafb928a5025390c3dc7ff0","created_at":"2026-09-04T07:30:06.950Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6859fee27a6435f4143d77f56c6995de","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fa8a0ece0cd4cd84b24392ba8b9b5eee48fc0e08f65c9b27e07e860a41c86462","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.977Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::MonitorLockedTablesWorker JID-bdafb928a5025390c3dc7ff0: start","job_status":"start","queue_duration_s":3.159204,"scheduling_latency_s":3.159245}1731gitlab # [ 349.887240] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:10.164Z","retry":0,"queue":"default","version":1,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::MonitorLockedTablesWorker","jid":"bdafb928a5025390c3dc7ff0","created_at":"2026-09-04T07:30:06.950Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6859fee27a6435f4143d77f56c6995de","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fa8a0ece0cd4cd84b24392ba8b9b5eee48fc0e08f65c9b27e07e860a41c86462","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:06.977Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::MonitorLockedTablesWorker JID-bdafb928a5025390c3dc7ff0: done: 0.027584 sec","job_status":"done","queue_duration_s":3.159204,"scheduling_latency_s":3.159245,"redis_calls":10,"redis_duration_s":0.002261,"redis_read_bytes":9,"redis_write_bytes":1101,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000541,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":313,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001228,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000492,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":218,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035446,"duration_s":0.027584,"completed_at":"2026-09-04T07:30:10.164Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000743,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1732gitlab # [ 349.931878] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:10.166Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"f9faf229e32c8d4615e32048","created_at":"2026-09-04T07:30:06.996Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cdbd8267c88171a818e59d201fbd22af","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:07.010Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-f9faf229e32c8d4615e32048: start","job_status":"start","queue_duration_s":3.156093,"scheduling_latency_s":3.156129}1733gitlab # [ 349.947652] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:10.233Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"f9faf229e32c8d4615e32048","created_at":"2026-09-04T07:30:06.996Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cdbd8267c88171a818e59d201fbd22af","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:07.010Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-f9faf229e32c8d4615e32048: done: 0.06741 sec","job_status":"done","queue_duration_s":3.156093,"scheduling_latency_s":3.156129,"redis_calls":10,"redis_duration_s":0.004502,"redis_read_bytes":135,"redis_write_bytes":1275,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.0002,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":106,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002006,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002296,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044552,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00229156,"exclusive_lock_hold_duration_s":0.02503066,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.06741,"completed_at":"2026-09-04T07:30:10.233Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016105,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1734gitlab # [ 349.996246] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:10.237Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"ff9f3a9fea55bf34a020bf64","created_at":"2026-09-04T07:30:07.042Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"02a3593a83565b9e1bd50e7ccb79e075","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:07.063Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-ff9f3a9fea55bf34a020bf64: start","job_status":"start","queue_duration_s":3.1739,"scheduling_latency_s":3.173945}1735gitlab # [ 350.010984] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:10.735Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"ff9f3a9fea55bf34a020bf64","created_at":"2026-09-04T07:30:07.042Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"02a3593a83565b9e1bd50e7ccb79e075","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:07.063Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-ff9f3a9fea55bf34a020bf64: done: 0.498567 sec","job_status":"done","queue_duration_s":3.1739,"scheduling_latency_s":3.173945,"redis_calls":563,"redis_duration_s":0.10729,"redis_read_bytes":688,"redis_write_bytes":48843,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000549,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":83,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002285,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.104456,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.450796,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.498567,"completed_at":"2026-09-04T07:30:10.735Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1736gitlab # [ 350.054681] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:10.737Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::Import::ImportFileCleanupWorker","jid":"3ec440917e7a1fe9319b2c4e","created_at":"2026-09-04T07:30:07.078Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af01a16d07e5df50ce5c13ba1edf8b10","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:872203d04eabf30611038084c617b8ff07fd3e5607b1d8e2c977d615a3cfd3cb","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:07.097Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::Import::ImportFileCleanupWorker JID-3ec440917e7a1fe9319b2c4e: start","job_status":"start","queue_duration_s":3.640815,"scheduling_latency_s":3.640851}1737gitlab # [ 350.069920] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:10.804Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::Import::ImportFileCleanupWorker","jid":"3ec440917e7a1fe9319b2c4e","created_at":"2026-09-04T07:30:07.078Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af01a16d07e5df50ce5c13ba1edf8b10","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:872203d04eabf30611038084c617b8ff07fd3e5607b1d8e2c977d615a3cfd3cb","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:07.097Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::Import::ImportFileCleanupWorker JID-3ec440917e7a1fe9319b2c4e: done: 0.066788 sec","job_status":"done","queue_duration_s":3.640815,"scheduling_latency_s":3.640851,"redis_calls":10,"redis_duration_s":0.004198,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00095,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002364,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000884,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00092892,"duration_s":0.066788,"completed_at":"2026-09-04T07:30:10.804Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006183,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1738gitlab # [ 350.114160] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:10.809Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"c27a157eb5b17a6bb46fed47","created_at":"2026-09-04T07:30:07.126Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"295936c3f84dc4bae5286cbb52b26d24","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:07.144Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-c27a157eb5b17a6bb46fed47: start","job_status":"start","queue_duration_s":3.664941,"scheduling_latency_s":3.665006}1739gitlab # [ 350.128598] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:10.861Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"c27a157eb5b17a6bb46fed47","created_at":"2026-09-04T07:30:07.126Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"295936c3f84dc4bae5286cbb52b26d24","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:07.144Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-c27a157eb5b17a6bb46fed47: done: 0.052123 sec","job_status":"done","queue_duration_s":3.664941,"scheduling_latency_s":3.665006,"redis_calls":10,"redis_duration_s":0.004835,"redis_read_bytes":135,"redis_write_bytes":1167,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000376,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":95,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002394,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002065,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03368,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00137686,"exclusive_lock_hold_duration_s":0.00860906,"duration_s":0.052123,"completed_at":"2026-09-04T07:30:10.861Z","load_balancing_strategy":"primary","db_duration_s":0.002329,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1740gitlab # [ 350.173822] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:10.865Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"dcd0206b6bcf693fd9c7a984","created_at":"2026-09-04T07:30:07.170Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9ea227f245d74018b7eccdf5d85a36a6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:07.179Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-dcd0206b6bcf693fd9c7a984: start","job_status":"start","queue_duration_s":3.685654,"scheduling_latency_s":3.685707}1741gitlab # [ 350.189269] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:10.887Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1742gitlab # [ 350.192660] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:10.899Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"dcd0206b6bcf693fd9c7a984","created_at":"2026-09-04T07:30:07.170Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9ea227f245d74018b7eccdf5d85a36a6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:07.179Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-dcd0206b6bcf693fd9c7a984: done: 0.034427 sec","job_status":"done","queue_duration_s":3.685654,"scheduling_latency_s":3.685707,"redis_calls":8,"redis_duration_s":0.003988,"redis_read_bytes":133,"redis_write_bytes":873,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000831,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":102,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002283,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000874,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034427,"completed_at":"2026-09-04T07:30:10.899Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1743gitlab # [ 350.237525] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:10.902Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"dbb813f2b47ea14301db64d6","created_at":"2026-09-04T07:30:07.194Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"47a443b8c6320ea3936e319b072a065c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:30:07.206Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-dbb813f2b47ea14301db64d6: start","job_status":"start","queue_duration_s":3.696343,"scheduling_latency_s":3.696389}1744gitlab # [ 350.251787] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:10.920Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1745gitlab # [ 350.255487] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:10.930Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"dbb813f2b47ea14301db64d6","created_at":"2026-09-04T07:30:07.194Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"47a443b8c6320ea3936e319b072a065c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:30:07.206Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-dbb813f2b47ea14301db64d6: done: 0.028053 sec","job_status":"done","queue_duration_s":3.696343,"scheduling_latency_s":3.696389,"redis_calls":8,"redis_duration_s":0.00289,"redis_read_bytes":133,"redis_write_bytes":914,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000329,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":108,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001814,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000747,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017314,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028053,"completed_at":"2026-09-04T07:30:10.930Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1746gitlab # [ 350.299526] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:10.933Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"f9187d6e35191e35f66beae9","created_at":"2026-09-04T07:30:07.250Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"014ea4b2d7c2a6006adc3f4bfb732d75","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:07.274Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-f9187d6e35191e35f66beae9: start","job_status":"start","queue_duration_s":3.65886,"scheduling_latency_s":3.658896}1747gitlab # [ 350.314981] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:10.964Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"f9187d6e35191e35f66beae9","created_at":"2026-09-04T07:30:07.250Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"014ea4b2d7c2a6006adc3f4bfb732d75","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:07.274Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-f9187d6e35191e35f66beae9: done: 0.031676 sec","job_status":"done","queue_duration_s":3.65886,"scheduling_latency_s":3.658896,"redis_calls":10,"redis_duration_s":0.003581,"redis_read_bytes":135,"redis_write_bytes":1227,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000298,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":100,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001759,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001524,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":591,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019872,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00095912,"exclusive_lock_hold_duration_s":0.0051884,"duration_s":0.031676,"completed_at":"2026-09-04T07:30:10.964Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001962,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1748gitlab # [ 350.360865] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:10.967Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"f5e3ccce6cacab06afff27e8","created_at":"2026-09-04T07:30:07.303Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"32ca765657c95e214a14829473f6b484","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:07.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-f5e3ccce6cacab06afff27e8: start","job_status":"start","queue_duration_s":3.629383,"scheduling_latency_s":3.62942}1749gitlab # [ 350.375395] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:11.000Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"f5e3ccce6cacab06afff27e8","created_at":"2026-09-04T07:30:07.303Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"32ca765657c95e214a14829473f6b484","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:07.337Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-f5e3ccce6cacab06afff27e8: done: 0.033788 sec","job_status":"done","queue_duration_s":3.629383,"scheduling_latency_s":3.62942,"redis_calls":12,"redis_duration_s":0.00423,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000827,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001922,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001481,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00044956,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.033788,"completed_at":"2026-09-04T07:30:11.000Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001079,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1750gitlab # [ 350.420887] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:11.003Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"fdc45b8ed8fb72985bfac47f","created_at":"2026-09-04T07:30:07.373Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c9d3dad25224a87020d62e937afe3a4b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:30:07.390Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-fdc45b8ed8fb72985bfac47f: start","job_status":"start","queue_duration_s":3.612963,"scheduling_latency_s":3.612999}1751gitlab # [ 350.434105] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:11.325Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"fdc45b8ed8fb72985bfac47f","created_at":"2026-09-04T07:30:07.373Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-e94c44b3ce0b40f1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c9d3dad25224a87020d62e937afe3a4b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:30:07.390Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-fdc45b8ed8fb72985bfac47f: done: 0.321892 sec","job_status":"done","queue_duration_s":3.612963,"scheduling_latency_s":3.612999,"redis_calls":8,"redis_duration_s":0.09682600000000001,"redis_read_bytes":133,"redis_write_bytes":836,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000234,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":95,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.013675,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.082917,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028762,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.321892,"completed_at":"2026-09-04T07:30:11.325Z","load_balancing_strategy":"primary","db_duration_s":0.006245,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1752gitlab # [ 350.475243] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:11.327Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"469db72650b2bdd094eb343c","created_at":"2026-09-04T07:30:09.789Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-20d1ac3d4ddb4c5e","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"7c86a8917606db509f1c514b51e55c21","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:09.801Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-469db72650b2bdd094eb343c: start","job_status":"start","queue_duration_s":1.525784,"scheduling_latency_s":1.525824}1753gitlab # [ 350.490594] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:11.377Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"469db72650b2bdd094eb343c","created_at":"2026-09-04T07:30:09.789Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-20d1ac3d4ddb4c5e","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"7c86a8917606db509f1c514b51e55c21","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:09.801Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-469db72650b2bdd094eb343c: done: 0.04995 sec","job_status":"done","queue_duration_s":1.525784,"scheduling_latency_s":1.525824,"redis_calls":10,"redis_duration_s":0.003009,"redis_read_bytes":9,"redis_write_bytes":1117,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000617,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001804,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000588,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":222,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029786,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004583,"duration_s":0.04995,"completed_at":"2026-09-04T07:30:11.377Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007372,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1754gitlab # [ 350.533926] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:11.379Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"d79809c14141ba4c5b508c84","created_at":"2026-09-04T07:30:09.803Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-20d1ac3d4ddb4c5e","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"7c86a8917606db509f1c514b51e55c21","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:09.811Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-d79809c14141ba4c5b508c84: start","job_status":"start","queue_duration_s":1.567959,"scheduling_latency_s":1.567997}1755gitlab # [ 350.549255] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:11.421Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"d79809c14141ba4c5b508c84","created_at":"2026-09-04T07:30:09.803Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-20d1ac3d4ddb4c5e","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"7c86a8917606db509f1c514b51e55c21","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:09.811Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-d79809c14141ba4c5b508c84: done: 0.041358 sec","job_status":"done","queue_duration_s":1.567959,"scheduling_latency_s":1.567997,"redis_calls":10,"redis_duration_s":0.002772,"redis_read_bytes":9,"redis_write_bytes":1133,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000594,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001575,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000603,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025833,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00043028,"duration_s":0.041358,"completed_at":"2026-09-04T07:30:11.420Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002349,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1756gitlab # [ 350.593953] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:11.423Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"1ed334cb8928a83d1b59afda","created_at":"2026-09-04T07:30:09.925Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-bb2ef1c0609644c1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"6529a5d746cf7501618e05526b34ea3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:09.946Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-1ed334cb8928a83d1b59afda: start","job_status":"start","queue_duration_s":1.477083,"scheduling_latency_s":1.477123}1757gitlab # [ 350.607105] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:11.495Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"1ed334cb8928a83d1b59afda","created_at":"2026-09-04T07:30:09.925Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-bb2ef1c0609644c1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"6529a5d746cf7501618e05526b34ea3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:09.946Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-1ed334cb8928a83d1b59afda: done: 0.072509 sec","job_status":"done","queue_duration_s":1.477083,"scheduling_latency_s":1.477123,"redis_calls":18,"redis_duration_s":0.00498,"redis_read_bytes":39,"redis_write_bytes":2116,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000572,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001321,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":471,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.003087,"redis_shared_state_read_bytes":34,"redis_shared_state_write_bytes":1324,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00043732,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":3,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":3,"duration_s":0.072509,"completed_at":"2026-09-04T07:30:11.495Z","load_balancing_strategy":"primary","db_duration_s":0.015563,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1758gitlab # [ 350.652131] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:11.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"8ac6f3c924c2f7c12e6e57fc","created_at":"2026-09-04T07:30:09.925Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-bb2ef1c0609644c1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"6529a5d746cf7501618e05526b34ea3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:09.946Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-8ac6f3c924c2f7c12e6e57fc: start","job_status":"start","queue_duration_s":1.551858,"scheduling_latency_s":1.551894}1759gitlab # [ 350.665046] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:11.541Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"8ac6f3c924c2f7c12e6e57fc","created_at":"2026-09-04T07:30:09.925Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-bb2ef1c0609644c1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"6529a5d746cf7501618e05526b34ea3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:09.946Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-8ac6f3c924c2f7c12e6e57fc: done: 0.043743 sec","job_status":"done","queue_duration_s":1.551858,"scheduling_latency_s":1.551894,"redis_calls":15,"redis_duration_s":0.003487,"redis_read_bytes":35,"redis_write_bytes":1707,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001147,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":383,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.00234,"redis_shared_state_read_bytes":32,"redis_shared_state_write_bytes":1324,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":3,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":3,"duration_s":0.043743,"completed_at":"2026-09-04T07:30:11.541Z","load_balancing_strategy":"primary","db_duration_s":0.005814,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1760gitlab # [ 350.708186] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:11.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"0df2e19d0b804a736c836f90","created_at":"2026-09-04T07:30:09.925Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-bb2ef1c0609644c1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"6529a5d746cf7501618e05526b34ea3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:09.946Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-0df2e19d0b804a736c836f90: start","job_status":"start","queue_duration_s":1.597843,"scheduling_latency_s":1.597883}1761gitlab # [ 350.720688] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:11.591Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"0df2e19d0b804a736c836f90","created_at":"2026-09-04T07:30:09.925Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-bb2ef1c0609644c1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"6529a5d746cf7501618e05526b34ea3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:09.946Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-0df2e19d0b804a736c836f90: done: 0.047779 sec","job_status":"done","queue_duration_s":1.597843,"scheduling_latency_s":1.597883,"redis_calls":15,"redis_duration_s":0.003509,"redis_read_bytes":35,"redis_write_bytes":1707,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001282,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":383,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.002227,"redis_shared_state_read_bytes":32,"redis_shared_state_write_bytes":1324,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030599,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":0,"duration_s":0.047779,"completed_at":"2026-09-04T07:30:11.591Z","load_balancing_strategy":"primary","db_duration_s":0.005115,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1762gitlab # [ 350.763479] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:11.594Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"1b4c8469acecf718910e78fd","created_at":"2026-09-04T07:30:09.925Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-bb2ef1c0609644c1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"6529a5d746cf7501618e05526b34ea3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:09.946Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-1b4c8469acecf718910e78fd: start","job_status":"start","queue_duration_s":1.647834,"scheduling_latency_s":1.647873}1763gitlab # [ 350.778298] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:11.637Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"1b4c8469acecf718910e78fd","created_at":"2026-09-04T07:30:09.925Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-bb2ef1c0609644c1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"6529a5d746cf7501618e05526b34ea3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:09.946Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-1b4c8469acecf718910e78fd: done: 0.04361 sec","job_status":"done","queue_duration_s":1.647834,"scheduling_latency_s":1.647873,"redis_calls":15,"redis_duration_s":0.003487,"redis_read_bytes":35,"redis_write_bytes":1707,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00117,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":383,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.002317,"redis_shared_state_read_bytes":32,"redis_shared_state_write_bytes":1324,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030424,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":0,"duration_s":0.04361,"completed_at":"2026-09-04T07:30:11.637Z","load_balancing_strategy":"primary","db_duration_s":0.005745,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1764gitlab # [ 350.822591] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:11.639Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"77c94916973b6f744fac8e8b","created_at":"2026-09-04T07:30:09.925Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-bb2ef1c0609644c1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"6529a5d746cf7501618e05526b34ea3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:09.946Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-77c94916973b6f744fac8e8b: start","job_status":"start","queue_duration_s":1.693575,"scheduling_latency_s":1.693651}1765gitlab # [ 350.836234] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:11.683Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"77c94916973b6f744fac8e8b","created_at":"2026-09-04T07:30:09.925Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-bb2ef1c0609644c1","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"6529a5d746cf7501618e05526b34ea3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:09.946Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-77c94916973b6f744fac8e8b: done: 0.044107 sec","job_status":"done","queue_duration_s":1.693575,"scheduling_latency_s":1.693651,"redis_calls":15,"redis_duration_s":0.0034319999999999997,"redis_read_bytes":35,"redis_write_bytes":1707,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00112,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":383,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.002312,"redis_shared_state_read_bytes":32,"redis_shared_state_write_bytes":1324,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":1,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":1,"duration_s":0.044107,"completed_at":"2026-09-04T07:30:11.683Z","load_balancing_strategy":"primary","db_duration_s":0.005263,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1766gitlab # [ 350.880808] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:11.686Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5582642f5972d4304378049d","created_at":"2026-09-04T07:30:10.084Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-df00a93bd98f4597","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5a7f231ad44ef7ba4606eef067b8af1b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:10.101Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5582642f5972d4304378049d: start","job_status":"start","queue_duration_s":1.585049,"scheduling_latency_s":1.585087}1767gitlab # [ 350.893831] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:11.711Z","message":"No existing merge request to be cleaned up."}1768gitlab # [ 350.895581] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:11.729Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5582642f5972d4304378049d","created_at":"2026-09-04T07:30:10.084Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-df00a93bd98f4597","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5a7f231ad44ef7ba4606eef067b8af1b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:10.101Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5582642f5972d4304378049d: done: 0.04342 sec","job_status":"done","queue_duration_s":1.585049,"scheduling_latency_s":1.585087,"redis_calls":11,"redis_duration_s":0.0036230000000000004,"redis_read_bytes":136,"redis_write_bytes":1104,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00025,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":82,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001411,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001962,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030835,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.04342,"completed_at":"2026-09-04T07:30:11.729Z","load_balancing_strategy":"primary","db_duration_s":0.005187,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1769gitlab # [ 350.938543] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:11.731Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"db7cfe1568f209c477f5b21b","created_at":"2026-09-04T07:30:10.084Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-df00a93bd98f4597","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5a7f231ad44ef7ba4606eef067b8af1b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:10.101Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-db7cfe1568f209c477f5b21b: start","job_status":"start","queue_duration_s":1.630581,"scheduling_latency_s":1.630618}1770gitlab # [ 350.951746] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:11.752Z","message":"No existing merge request to be cleaned up."}1771gitlab # [ 350.953705] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:11.769Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"db7cfe1568f209c477f5b21b","created_at":"2026-09-04T07:30:10.084Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-df00a93bd98f4597","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5a7f231ad44ef7ba4606eef067b8af1b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:10.101Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-db7cfe1568f209c477f5b21b: done: 0.038196 sec","job_status":"done","queue_duration_s":1.630581,"scheduling_latency_s":1.630618,"redis_calls":10,"redis_duration_s":0.002725,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001214,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001511,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038196,"completed_at":"2026-09-04T07:30:11.769Z","load_balancing_strategy":"primary","db_duration_s":0.002882,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1772gitlab # [ 350.995961] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:11.772Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8e38f69aaaa6112606adb4fd","created_at":"2026-09-04T07:30:10.084Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-df00a93bd98f4597","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5a7f231ad44ef7ba4606eef067b8af1b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:10.101Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8e38f69aaaa6112606adb4fd: start","job_status":"start","queue_duration_s":1.671034,"scheduling_latency_s":1.671072}1773gitlab # [ 351.009117] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:11.790Z","message":"No existing merge request to be cleaned up."}1774gitlab # [ 351.010902] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:11.809Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8e38f69aaaa6112606adb4fd","created_at":"2026-09-04T07:30:10.084Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-df00a93bd98f4597","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5a7f231ad44ef7ba4606eef067b8af1b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:10.101Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8e38f69aaaa6112606adb4fd: done: 0.037053 sec","job_status":"done","queue_duration_s":1.671034,"scheduling_latency_s":1.671072,"redis_calls":10,"redis_duration_s":0.004314,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001206,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003108,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026679,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037053,"completed_at":"2026-09-04T07:30:11.809Z","load_balancing_strategy":"primary","db_duration_s":0.002987,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1775gitlab # [ 351.051879] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:11.811Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b9b9862863afab189e948b94","created_at":"2026-09-04T07:30:10.084Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-df00a93bd98f4597","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5a7f231ad44ef7ba4606eef067b8af1b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:10.101Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b9b9862863afab189e948b94: start","job_status":"start","queue_duration_s":1.710125,"scheduling_latency_s":1.710163}1776gitlab # [ 351.064961] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:11.831Z","message":"No existing merge request to be cleaned up."}1777gitlab # [ 351.066758] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:11.847Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b9b9862863afab189e948b94","created_at":"2026-09-04T07:30:10.084Z","trace_propagation_headers":{"sentry-trace":"d1dd45554555409a8401286e72d4196f-df00a93bd98f4597","baggage":"sentry-trace_id=d1dd45554555409a8401286e72d4196f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5a7f231ad44ef7ba4606eef067b8af1b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:10.101Z","job_size_bytes":2,"pid":2077,"sidekiq_tid":"m7oh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b9b9862863afab189e948b94: done: 0.036012 sec","job_status":"done","queue_duration_s":1.710125,"scheduling_latency_s":1.710163,"redis_calls":10,"redis_duration_s":0.002798,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001209,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001589,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036012,"completed_at":"2026-09-04T07:30:11.847Z","load_balancing_strategy":"primary","db_duration_s":0.00267,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1778gitlab # [ 367.111877] postgres[3635]: [3635] ERROR: relation "table_without_models" does not exist1779gitlab # [ 367.112247] postgres[3635]: [3635] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1780gitlab # [ 374.489699] runuser[3223]: pam_unix(runuser:session): session closed for user gitlab1781gitlab # [ 374.490938] setup-gitlab-start[3195]: + systemctl restart gitlab-sidekiq.service1782gitlab # [ 374.522769] systemd[1]: Stopping gitlab-sidekiq.service...1783gitlab # [ 374.572549] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:36.457Z","message":"Shutting down"}1784gitlab # [ 374.575217] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:36.458Z","message":"Scheduler exiting..."}1785gitlab # [ 374.577740] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:36.458Z","message":"Terminating quiet threads for default capsule"}1786gitlab # [ 374.580360] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:36.459Z","message":"Scheduler exiting..."}1787gitlab # [ 375.074918] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:36.960Z","message":"Pausing to allow jobs to finish..."}1788gitlab # [ 375.585654] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:37.470Z","message":"Bye!"}1789gitlab # [ 375.614748] sidekiq-cluster[2077]: {"severity":"INFO","time":"2026-09-04T07:30:37.500Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2077,"worker_id":"sidekiq_0","memwd_rss_bytes":961548288,"retry":0}1790gitlab # [ 376.465082] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1791gitlab # [ 376.465426] systemd[1]: Stopped gitlab-sidekiq.service.1792gitlab # [ 376.465546] systemd[1]: gitlab-sidekiq.service: Consumed 2min 28.878s CPU time over 4min 5.972s wall clock time, 948.1M memory peak, 4.5M read from disk.1793gitlab # [ 376.473275] systemd[1]: Started gitlab-sidekiq.service.1794gitlab # [ 376.475628] setup-gitlab-start[3195]: + mkdir -p /var/lib/secrets1795gitlab # [ 376.477318] setup-gitlab-start[3195]: + echo nixbot-test-token-of-20-chars1796gitlab # [ 376.478829] setup-gitlab-start[3195]: + chmod 644 /var/lib/secrets/gitlab-token1797gitlab # [ 376.481587] setup-gitlab-start[3195]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1798gitlab # [ 378.275326] gitaly[896]: time="2026-09-04T07:30:40.160Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN78NHXB227T4G0Z8ZFD30 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:30:50.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:40.160" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1799gitlab # [ 378.276417] gitaly[896]: time="2026-09-04T07:30:40.160Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN78NHXB227T4G0Z8ZFD30 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:30:50.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:40.160" grpc.time_ms=0.646 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1800gitlab # [ 378.574153] gitaly[896]: time="2026-09-04T07:30:40.459Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN78NHXB227T4G0Z8ZFD30 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:30:50.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:40.459" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1801gitlab # [ 378.605296] gitaly[896]: time="2026-09-04T07:30:40.459Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN78NHXB227T4G0Z8ZFD30 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:30:50.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:40.459" grpc.time_ms=0.492 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1802gitlab # [ 378.701559] gitaly[896]: time="2026-09-04T07:30:40.587Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN78NHXB227T4G0Z8ZFD30 diskcache=f3304d11-f26a-412f-b982-5607fe54df84 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T07:30:50.036" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:40.487" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1803gitlab # [ 378.716538] gitaly[896]: time="2026-09-04T07:30:40.588Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1438 command.oublock=32 command.real_time_ms=50 command.spawn_token_fork_ms=5 command.system_time_ms=15 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN78NHXB227T4G0Z8ZFD30 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T07:30:50.036" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:40.487" grpc.time_ms=100.514 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1804gitlab # [ 378.761859] gitaly[896]: time="2026-09-04T07:30:40.647Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN78NHXB227T4G0Z8ZFD30 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:30:50.196" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:40.647" pid=896 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1805gitlab # [ 378.778681] gitaly[896]: time="2026-09-04T07:30:40.648Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN78NHXB227T4G0Z8ZFD30 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:30:50.196" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:40.647" grpc.time_ms=1.03 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1806gitlab # [ 378.796167] gitaly[896]: time="2026-09-04T07:30:40.679Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=9 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN78NHXB227T4G0Z8ZFD30 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:30:50.213" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:40.663" grpc.time_ms=15.515 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1807gitlab # [ 378.945724] gitaly[896]: time="2026-09-04T07:30:40.831Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN78NHXB227T4G0Z8ZFD30 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:30:50.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:40.831" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1808gitlab # [ 378.960131] gitaly[896]: time="2026-09-04T07:30:40.831Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN78NHXB227T4G0Z8ZFD30 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:30:50.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:40.831" grpc.time_ms=0.48 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1809gitlab # [ 379.064820] gitaly[896]: time="2026-09-04T07:30:40.950Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN78NHXB227T4G0Z8ZFD30 diskcache=a8939bd5-ceb4-4d7c-b55c-a6e9c44ee5d3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T07:30:50.023" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:40.844" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1810gitlab # [ 379.079622] gitaly[896]: time="2026-09-04T07:30:40.950Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=24 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1437 command.oublock=32 command.real_time_ms=52 command.spawn_token_fork_ms=20 command.system_time_ms=19 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN78NHXB227T4G0Z8ZFD30 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T07:30:50.023" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:40.844" grpc.time_ms=105.558 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1811gitlab # [ 379.100651] gitaly[896]: time="2026-09-04T07:30:40.969Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN78NHXB227T4G0Z8ZFD30 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:30:50.148" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:40.969" pid=896 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1812gitlab # [ 379.116418] gitaly[896]: time="2026-09-04T07:30:40.970Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN78NHXB227T4G0Z8ZFD30 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:30:50.148" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:40.969" grpc.time_ms=0.838 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1813gitlab # [ 379.132917] gitaly[896]: time="2026-09-04T07:30:41.003Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=7 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN78NHXB227T4G0Z8ZFD30 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:30:50.158" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:40.979" grpc.time_ms=19.548 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1814gitlab # [ 379.189398] gitaly[896]: time="2026-09-04T07:30:41.075Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN78NHXB227T4G0Z8ZFD30 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:30:51.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:41.075" grpc.time_ms=0.238 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1815gitlab # [ 379.204977] gitaly[896]: time="2026-09-04T07:30:41.090Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN78NHXB227T4G0Z8ZFD30 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T07:30:51.019" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:41.090" grpc.time_ms=0.693 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1816gitlab # [ 380.534101] gitaly[896]: time="2026-09-04T07:30:42.419Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=5 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN78NHXB227T4G0Z8ZFD30 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:30:52.248" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:42.399" grpc.time_ms=19.706 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1817gitlab # [ 381.089297] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:42 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 45851818gitlab # [ 381.091767] setup-gitlab-start[3195]: + mkdir -p /tmp/test-flake1819gitlab # [ 381.098939] setup-gitlab-start[3195]: + cd /tmp/test-flake1820gitlab # [ 381.100742] setup-gitlab-start[3195]: + git init -b master1821gitlab # [ 381.136848] setup-gitlab-start[3754]: Initialized empty Git repository in /tmp/test-flake/.git/1822gitlab # [ 381.140078] setup-gitlab-start[3195]: + git config user.name test1823gitlab # [ 381.151683] setup-gitlab-start[3195]: + git config user.email test@example.com1824gitlab # [ 381.155804] setup-gitlab-start[3195]: + cat1825gitlab # [ 381.165873] setup-gitlab-start[3195]: + git add flake.nix1826gitlab # [ 381.169008] setup-gitlab-start[3195]: + git commit -m 'initial commit'1827gitlab # [ 381.207751] setup-gitlab-start[3759]: [master (root-commit) e8a33ab] initial commit1828gitlab # [ 381.210093] setup-gitlab-start[3759]: 1 file changed, 10 insertions(+)1829gitlab # [ 381.211610] setup-gitlab-start[3759]: create mode 100644 flake.nix1830gitlab # [ 381.213273] setup-gitlab-start[3195]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1831gitlab # [ 381.216118] setup-gitlab-start[3195]: + git push -u origin master1832gitlab # [ 381.545170] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:43 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 2941833gitlab # [ 382.712185] gitaly[896]: time="2026-09-04T07:30:44.597Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7DK8Y2CTW4JETGMJE9ZT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:44.581" grpc.time_ms=15.739 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1834gitlab # [ 382.728150] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:44 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 11651835gitlab # [ 383.335736] gitaly[896]: time="2026-09-04T07:30:45.221Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=10 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:30:55.004" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:45.204" grpc.time_ms=16.322 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1836gitlab # [ 383.443843] gitaly[896]: time="2026-09-04T07:30:45.329Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=5 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-04T07:31:15.016" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-04T07:30:45.316" grpc.time_ms=12.886 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1837gitlab # [ 383.526714] gitaly[896]: time="2026-09-04T07:30:45.412Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 duration_ms=483ns method=POST pid=896 status=200 url="http://unix/api/v4/internal/allowed"1838gitlab # [ 383.606145] gitaly[896]: time="2026-09-04T07:30:45.492Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 duration_ms=78ns method=POST pid=896 status=200 url="http://unix/api/v4/internal/pre_receive"1839gitlab # [ 383.612671] gitaly[896]: time="2026-09-04T07:30:45.492Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:30:44.927" grpc.time_ms=564.74 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1840gitlab # [ 383.695145] gitaly[896]: time="2026-09-04T07:30:45.576Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:30:45.574" grpc.time_ms=1.672 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1841gitlab # [ 383.748391] gitaly[896]: time="2026-09-04T07:30:45.633Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:30:45.633" grpc.time_ms=0.731 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1842gitlab # [ 383.805751] gitaly[896]: time="2026-09-04T07:30:45.691Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:30:45.688" grpc.time_ms=2.771 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1843gitlab # [ 384.187095] gitaly[896]: time="2026-09-04T07:30:46.072Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:30:56.005" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:46.055" grpc.time_ms=16.833 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1844gitlab # [ 384.301402] gitaly[896]: time="2026-09-04T07:30:46.187Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1435 command.oublock=0 command.real_time_ms=40 command.spawn_token_fork_ms=20 command.system_time_ms=14 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-04T07:30:56.089" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:30:46.140" grpc.time_ms=46.33 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1845gitlab # [ 384.349975] gitaly[896]: time="2026-09-04T07:30:46.236Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 duration_ms=487ns method=POST pid=896 status=200 url="http://unix/api/v4/internal/post_receive"1846gitlab # [ 384.356809] gitaly[896]: time="2026-09-04T07:30:46.237Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:30:45.748" grpc.time_ms=489.238 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1847gitlab # [ 384.381211] gitaly[896]: time="2026-09-04T07:30:46.253Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 diskcache=1b0a1f2e-68c9-46bb-b216-ee661854ef82 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:44.790" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1848gitlab # [ 384.398304] gitlab-workhorse[816]: time="2026-09-04T07:30:46Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521849gitlab # [ 384.401579] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:46 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 16521850gitlab # [ 384.405109] systemd[1]: Finished setup-gitlab.service.1851gitlab # [ 384.406590] setup-gitlab-start[3763]: To http://gitlab/root/test-flake.git1852gitlab # [ 384.408097] setup-gitlab-start[3763]: * [new branch] master -> master1853gitlab # [ 384.409496] setup-gitlab-start[3763]: branch 'master' set up to track 'origin/master'.1854gitlab # [ 384.411149] gitaly[896]: time="2026-09-04T07:30:46.254Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=248 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=12978 command.oublock=32 command.real_time_ms=1449 command.spawn_token_fork_ms=11 command.system_time_ms=154 command.user_time_ms=94 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:44.790" grpc.time_ms=1463.17 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1855gitlab # [ 384.431293] systemd[1]: Starting nixbot CI service...1856gitlab: (finished: waiting for unit setup-gitlab.service, in 385.93 seconds)1857gitlab: waiting for unit nixbot.service1858gitlab # [ 385.965554] sidekiq-cluster[3694]: {"severity":"INFO","time":"2026-09-04T07:30:47.796Z","message":"Starting cluster with 1 processes"}1859gitlab # [ 387.066637] nixbot[3856]: {"ts": "2026-09-04T07:30:48.951Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1860gitlab # [ 387.120972] nixbot[3856]: {"ts": "2026-09-04T07:30:49.006Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1861gitlab # [ 387.180216] nixbot[3856]: {"ts": "2026-09-04T07:30:49.065Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1862gitlab # [ 387.196315] nixbot[3856]: {"ts": "2026-09-04T07:30:49.079Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1863gitlab # [ 387.223118] nixbot[3856]: {"ts": "2026-09-04T07:30:49.108Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1864gitlab # [ 387.244951] nixbot[3856]: {"ts": "2026-09-04T07:30:49.129Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1865gitlab # [ 387.258953] nixbot[3856]: {"ts": "2026-09-04T07:30:49.144Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1866gitlab # [ 387.269506] nixbot[3856]: {"ts": "2026-09-04T07:30:49.151Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1867gitlab # [ 387.283404] nixbot[3856]: {"ts": "2026-09-04T07:30:49.169Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1868gitlab # [ 387.291267] nixbot[3856]: {"ts": "2026-09-04T07:30:49.176Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1869gitlab # [ 387.304137] nixbot[3856]: {"ts": "2026-09-04T07:30:49.189Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1870gitlab # [ 387.316635] nixbot[3856]: {"ts": "2026-09-04T07:30:49.201Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1871gitlab # [ 387.328300] nixbot[3856]: {"ts": "2026-09-04T07:30:49.214Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1872gitlab # [ 387.335627] nixbot[3856]: {"ts": "2026-09-04T07:30:49.220Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1873gitlab # [ 387.343853] nixbot[3856]: {"ts": "2026-09-04T07:30:49.228Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1874gitlab # [ 387.351179] nixbot[3856]: {"ts": "2026-09-04T07:30:49.236Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1875gitlab # [ 387.359229] nixbot[3856]: {"ts": "2026-09-04T07:30:49.245Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1876gitlab # [ 387.369514] nixbot[3856]: {"ts": "2026-09-04T07:30:49.251Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1877gitlab # [ 387.377115] nixbot[3856]: {"ts": "2026-09-04T07:30:49.262Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1878gitlab # [ 387.383271] nixbot[3856]: {"ts": "2026-09-04T07:30:49.269Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1879gitlab # [ 387.394354] nixbot[3856]: {"ts": "2026-09-04T07:30:49.280Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1880gitlab # [ 387.404341] nixbot[3856]: {"ts": "2026-09-04T07:30:49.290Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1881gitlab # [ 387.415888] nixbot[3856]: {"ts": "2026-09-04T07:30:49.301Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1882gitlab # [ 387.425492] nixbot[3856]: {"ts": "2026-09-04T07:30:49.309Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1883gitlab # [ 387.434932] nixbot[3856]: {"ts": "2026-09-04T07:30:49.320Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1884gitlab # [ 387.442726] nixbot[3856]: {"ts": "2026-09-04T07:30:49.328Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1885gitlab # [ 387.448953] nixbot[3856]: {"ts": "2026-09-04T07:30:49.334Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1886gitlab # [ 387.454255] nixbot[3856]: {"ts": "2026-09-04T07:30:49.340Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1887gitlab # [ 387.460981] nixbot[3856]: {"ts": "2026-09-04T07:30:49.346Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1888gitlab # [ 387.481228] nixbot[3856]: {"ts": "2026-09-04T07:30:49.366Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1889gitlab # [ 387.491681] nixbot[3856]: {"ts": "2026-09-04T07:30:49.377Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1890gitlab # [ 388.108983] nixbot[3856]: INFO: Started server process [3856]1891gitlab # [ 388.110272] nixbot[3856]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1892gitlab # [ 388.153782] nixbot[3856]: INFO: ::ffff:127.0.0.1:58898 - "GET /health HTTP/1.1" 200 OK1893gitlab # [ 388.161910] systemd[1]: Started nixbot CI service.1894gitlab # [ 388.165732] systemd[1]: Reached target Multi-User System.1895gitlab # [ 388.168447] systemd[1]: Startup finished in 731ms (kernel) + 5.167s (initrd) + 6min 22.269s (userspace) = 6min 28.168s.1896gitlab: (finished: waiting for unit nixbot.service, in 3.12 seconds)1897gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1898gitlab # [ 388.628971] nixbot[3856]: INFO: ::ffff:127.0.0.1:58912 - "GET /health HTTP/1.1" 200 OK1899gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1900subtest: project discovered and webhook registered1901gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1902gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.23 seconds)1903gitlab # [ 388.851171] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:50 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1791904gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1905gitlab # [ 390.014737] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:51 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1141906gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.16 seconds)1907gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1908gitlab # [ 391.171296] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:53 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1181909gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.15 seconds)1910gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1911gitlab # [ 392.320795] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:54 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1121912gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.15 seconds)1913gitlab # [ 393.098958] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:54 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 49401914gitlab # [ 393.099732] nixbot[3856]: {"ts": "2026-09-04T07:30:54.982Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1915gitlab # [ 393.138258] nixbot[3856]: {"ts": "2026-09-04T07:30:55.024Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1916gitlab # [ 393.295958] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:55 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1421917gitlab # [ 393.298418] nixbot[3856]: {"ts": "2026-09-04T07:30:55.183Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1918gitlab # [ 393.300787] nixbot[3856]: {"ts": "2026-09-04T07:30:55.185Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1919gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1920gitlab # [ 393.468612] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:55 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1091921gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.15 seconds)1922gitlab # [ 393.643955] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:55 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 918 "" "python-httpx/0.28.1" 3401923gitlab # [ 393.647632] nixbot[3856]: {"ts": "2026-09-04T07:30:55.531Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1924gitlab # [ 394.058762] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:55 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 4011925gitlab # [ 394.062023] nixbot[3856]: {"ts": "2026-09-04T07:30:55.946Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1926gitlab # [ 394.269390] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:56 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "python-httpx/0.28.1" 1891927gitlab # [ 394.275725] nixbot[3856]: {"ts": "2026-09-04T07:30:56.156Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1928gitlab # [ 394.425832] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:56 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 918 "" "python-httpx/0.28.1" 1471929gitlab # [ 394.429427] nixbot[3856]: {"ts": "2026-09-04T07:30:56.313Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1930gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1931gitlab # [ 394.624717] gitaly[896]: time="2026-09-04T07:30:56.510Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=11 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7T6AGGC99JP1GH0DJDDF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-04T07:31:26.088" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:30:56.488" grpc.time_ms=20.687 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1932gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.18 seconds)1933(finished: subtest: project discovered and webhook registered, in 6.02 seconds)1934subtest: push delivers the webhook1935gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1936gitlab # [ 394.651079] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:56 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "curl/8.21.0" 1331937gitlab # [ 394.681638] gitaly[896]: time="2026-09-04T07:30:56.565Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7T6AGGC99JP1GH0DJDDF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:31:26.162" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:30:56.562" grpc.time_ms=2.813 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1938gitlab # [ 394.708189] gitaly[896]: time="2026-09-04T07:30:56.594Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=5 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7T6AGGC99JP1GH0DJDDF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-04T07:31:06.127" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:30:56.577" grpc.time_ms=15.931 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1939gitlab # [ 394.804096] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:56 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 3591940gitlab # [ 394.807979] nixbot[3856]: {"ts": "2026-09-04T07:30:56.692Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1941gitlab # [ 394.827881] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:56 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 781942gitlab # [ 394.998132] gitaly[896]: time="2026-09-04T07:30:56.883Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=6 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7TJB6JAM7P1P820KPKV5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:56.866" grpc.time_ms=16.774 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1943gitlab # Enumerating objects: 5, done.1944gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1945gitlab # Delta compression using up to 4 threads1946gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1947gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 136.00 KiB/s, done.1948gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1949gitlab # [ 395.040450] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:56 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 203 "" "git/2.55.0" 1691950gitlab # [ 395.044422] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:56 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 2201951gitlab # [ 395.048583] nixbot[3856]: {"ts": "2026-09-04T07:30:56.921Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1952gitlab # [ 395.055231] nixbot[3856]: {"ts": "2026-09-04T07:30:56.940Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1953gitlab # [ 395.273864] gitaly[896]: time="2026-09-04T07:30:57.157Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7TVBV9XA04XH015698EB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:57.144" grpc.time_ms=13.417 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc1954gitlab # [ 395.299456] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:57 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1541955gitlab # [ 395.495048] gitaly[896]: time="2026-09-04T07:30:57.381Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7V0D59X14RZEWZ2XVCWG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:57.366" pid=896 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1956gitlab # [ 395.516210] gitaly[896]: time="2026-09-04T07:30:57.382Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7V0D59X14RZEWZ2XVCWG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:57.366" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc1957gitlab # [ 395.535882] gitlab-workhorse[816]: time="2026-09-04T07:30:57Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131958gitlab # [ 395.538981] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:57 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 2191959gitlab # [ 395.541989] gitaly[896]: time="2026-09-04T07:30:57.383Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7V0D59X14RZEWZ2XVCWG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:57.366" grpc.time_ms=16.144 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc1960gitlab # [ 395.729968] gitaly[896]: time="2026-09-04T07:30:57.614Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7V7D6F7HXH8QP948EGH8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:57.576" pid=896 remote_ip="2001:db8:1::1" request_sha=cc21fcc84b6b4db739bc0c566bcfcb9aa21f3ea3 response_bytes=223 span.kind=server system=grpc1961gitlab # [ 395.751462] gitaly[896]: time="2026-09-04T07:30:57.614Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1135 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=13 command.system_time_ms=8 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7V7D6F7HXH8QP948EGH8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:57.576" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc1962gitlab # [ 395.778920] gitlab-workhorse[816]: time="2026-09-04T07:30:57Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231963gitlab # [ 395.784826] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:57 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 2271964gitlab # [ 395.787767] gitaly[896]: time="2026-09-04T07:30:57.615Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1135 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=13 command.system_time_ms=8 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7V7D6F7HXH8QP948EGH8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:57.576" grpc.time_ms=38.262 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc1965gitlab # [ 395.894554] gitaly[896]: time="2026-09-04T07:30:57.780Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7TRR78KHX0BDGKW9AFXT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-04T07:31:27.366" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-04T07:30:57.766" grpc.time_ms=13.054 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1966gitlab # [ 395.952131] gitaly[896]: time="2026-09-04T07:30:57.837Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1NN7TRR78KHX0BDGKW9AFXT duration_ms=598ns method=POST pid=896 status=200 url="http://unix/api/v4/internal/allowed"1967gitlab # [ 396.001072] gitaly[896]: time="2026-09-04T07:30:57.887Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=8 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7VHYQ4CKVDJ9R7422VN5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:57.867" grpc.time_ms=18.838 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc1968gitlab # [ 396.031324] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:57 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1621969gitlab # [ 396.043297] gitaly[896]: time="2026-09-04T07:30:57.929Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1NN7TRR78KHX0BDGKW9AFXT duration_ms=91ns method=POST pid=896 status=200 url="http://unix/api/v4/internal/pre_receive"1970gitlab # [ 396.053472] gitaly[896]: time="2026-09-04T07:30:57.934Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NN7TRR78KHX0BDGKW9AFXT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:30:57.238" grpc.time_ms=696.52 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1971gitlab # [ 396.100854] gitaly[896]: time="2026-09-04T07:30:57.986Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NN7TRR78KHX0BDGKW9AFXT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:30:57.984" grpc.time_ms=1.742 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1972gitlab # [ 396.200135] gitaly[896]: time="2026-09-04T07:30:58.086Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NN7TRR78KHX0BDGKW9AFXT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:30:58.082" grpc.time_ms=2.91 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1973gitlab # [ 396.224230] gitaly[896]: time="2026-09-04T07:30:58.103Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7VQ9MNHFGA67H9A4EQY2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:58.081" pid=896 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1974gitlab # [ 396.243711] gitlab-workhorse[816]: time="2026-09-04T07:30:58Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671975gitlab # [ 396.247023] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:58 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 2071976gitlab # [ 396.250235] gitaly[896]: time="2026-09-04T07:30:58.103Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=3 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7VQ9MNHFGA67H9A4EQY2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:58.081" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc1977gitlab # [ 396.275846] gitaly[896]: time="2026-09-04T07:30:58.104Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=3 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7VQ9MNHFGA67H9A4EQY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:58.081" grpc.time_ms=22.557 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc1978gitlab # [ 396.300440] gitaly[896]: time="2026-09-04T07:30:58.142Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NN7TRR78KHX0BDGKW9AFXT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:30:58.141" grpc.time_ms=1.716 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1979gitlab # [ 396.418934] gitaly[896]: time="2026-09-04T07:30:58.305Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1NN7TRR78KHX0BDGKW9AFXT duration_ms=101ns method=POST pid=896 status=200 url="http://unix/api/v4/internal/post_receive"1980gitlab # [ 396.432307] gitaly[896]: time="2026-09-04T07:30:58.310Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NN7TRR78KHX0BDGKW9AFXT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:30:58.183" grpc.time_ms=126.271 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1981gitlab # [ 396.453839] gitaly[896]: time="2026-09-04T07:30:58.324Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=15 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7VZW0EP350MJ9ZP1B1G9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:58.290" grpc.time_ms=28.681 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc1982gitlab # [ 396.474522] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:58 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1471983gitlab # To http://gitlab/root/test-flake.git1984gitlab # [ 396.478070] gitlab-workhorse[816]: time="2026-09-04T07:30:58Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521985gitlab # [ 396.480999] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:58 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 14371986gitlab # [ 396.483174] gitaly[896]: time="2026-09-04T07:30:58.357Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1NN7TRR78KHX0BDGKW9AFXT diskcache=ebb2c60b-3d4c-4f1c-935e-a6899f9ce35a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:57.113" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1987gitlab # e8a33ab..fa1e5af [ 396.497017] gitaly[896]: time="2026-09-04T07:30:58.358Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=232 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13207 command.oublock=32 command.real_time_ms=1201 command.spawn_token_fork_ms=6 command.system_time_ms=123 command.user_time_ms=109 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7TRR78KHX0BDGKW9AFXT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:57.113" grpc.time_ms=1243.948 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1988gitlab # master -> master1989gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.89 seconds)1990gitlab: must succeed: git -C /tmp/test-flake rev-parse master1991gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1992gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'1993gitlab # [ 396.654052] gitaly[896]: time="2026-09-04T07:30:58.539Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7W4J5Z5KPC4D7B6X5W7Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:58.509" pid=896 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1994gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.12 seconds)1995gitlab # [ 396.680811] gitaly[896]: time="2026-09-04T07:30:58.540Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=27 command.spawn_token_fork_ms=5 command.system_time_ms=19 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7W4J5Z5KPC4D7B6X5W7Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:58.509" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc1996gitlab # [ 396.706732] nixbot[3856]: INFO: ::ffff:127.0.0.1:50456 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK1997gitlab # [ 396.713557] gitlab-workhorse[816]: time="2026-09-04T07:30:58Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091998gitlab # [ 396.715692] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:58 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 2181999gitlab # [ 396.727108] gitaly[896]: time="2026-09-04T07:30:58.540Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=27 command.spawn_token_fork_ms=5 command.system_time_ms=19 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7W4J5Z5KPC4D7B6X5W7Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:58.509" grpc.time_ms=31.153 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2000gitlab # [ 396.894125] gitaly[896]: time="2026-09-04T07:30:58.779Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7WEM380H2A4Z9FJ9Y346 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:31:28.377" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:30:58.778" grpc.time_ms=1.025 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2001gitlab # [ 396.960919] gitaly[896]: time="2026-09-04T07:30:58.846Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=5 command.system_time_ms=5 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7WEM380H2A4Z9FJ9Y346 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-04T07:31:28.433" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:30:58.833" grpc.time_ms=13.258 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2002gitlab # [ 397.064849] gitaly[896]: time="2026-09-04T07:30:58.950Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=38 command.spawn_token_fork_ms=19 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7WEM380H2A4Z9FJ9Y346 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:31:08.090" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:30:58.911" grpc.time_ms=39.739 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2003gitlab # [ 397.146396] gitaly[896]: time="2026-09-04T07:30:59.032Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7WEM380H2A4Z9FJ9Y346 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:31:09.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:30:59.018" grpc.time_ms=13.883 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2004gitlab # [ 397.320617] gitaly[896]: time="2026-09-04T07:30:59.206Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7WEM380H2A4Z9FJ9Y346 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T07:31:09.194" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:59.205" grpc.time_ms=0.535 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2005gitlab # [ 397.362906] gitaly[896]: time="2026-09-04T07:30:59.248Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7WEM380H2A4Z9FJ9Y346 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T07:31:09.223" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:30:59.234" grpc.time_ms=13.969 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2006gitlab # [ 397.480917] gitaly[896]: time="2026-09-04T07:30:59.366Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NN7WEM380H2A4Z9FJ9Y346 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:30:59.365" grpc.time_ms=0.881 pid=896 span.kind=server system=grpc2007gitlab # [ 397.529912] gitaly[896]: time="2026-09-04T07:30:59.415Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NN7WEM380H2A4Z9FJ9Y346 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:30:59.414" grpc.time_ms=0.657 pid=896 span.kind=server system=grpc2008gitlab # [ 397.561532] gitaly[896]: time="2026-09-04T07:30:59.446Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7WEM380H2A4Z9FJ9Y346 diskcache=dfe7a342-dace-4e26-9945-096a0d487a21 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:31:09.244" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:59.255" pid=896 ref=refs/keep-around/e8a33ab956c0696d86aed7fb4ce82a7e2b45986f remote_ip="2001:db8:1::1" revision=e8a33ab956c0696d86aed7fb4ce82a7e2b45986f span.kind=server system=grpc username=root2009gitlab # [ 397.579071] gitaly[896]: time="2026-09-04T07:30:59.447Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=86 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5163 command.oublock=8 command.real_time_ms=175 command.spawn_token_fork_ms=5 command.system_time_ms=56 command.user_time_ms=30 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7WEM380H2A4Z9FJ9Y346 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:31:09.244" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:59.255" grpc.time_ms=191.364 pid=896 ref=refs/keep-around/e8a33ab956c0696d86aed7fb4ce82a7e2b45986f remote_ip="2001:db8:1::1" revision=e8a33ab956c0696d86aed7fb4ce82a7e2b45986f span.kind=server system=grpc username=root2010gitlab # [ 397.601593] gitaly[896]: time="2026-09-04T07:30:59.462Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7WEM380H2A4Z9FJ9Y346 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:31:29.061" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:30:59.461" grpc.time_ms=0.571 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2011gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2012gitlab # [ 397.730412] nixbot[3856]: INFO: ::ffff:127.0.0.1:50464 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2013gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2014gitlab # [ 397.977169] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:59 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e8a33ab956c0696d86aed7fb4ce82a7e2b45986f HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 12102015gitlab # [ 397.996840] nixbot[3856]: {"ts": "2026-09-04T07:30:59.864Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e8a33ab956c0696d86aed7fb4ce82a7e2b45986f \"HTTP/1.1 201 Created\""}2016gitlab # [ 398.021341] nixbot[3856]: {"ts": "2026-09-04T07:30:59.900Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-e8a33ab956c0-0"}2017gitlab # [ 398.274384] nixbot[3856]: {"ts": "2026-09-04T07:31:00.160Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-e8a33ab956c0-0", "argv0": "bwrap"}2018gitlab # [ 398.422317] systemd[1]: Started Nix Daemon.2019gitlab # [ 398.525148] nix-daemon[4116]: accepted connection from pid 4111, user nixbot2020gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2021gitlab # [ 398.805091] nixbot[3856]: INFO: ::ffff:127.0.0.1:50476 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2022gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.07 seconds)2023gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2024gitlab # [ 399.851158] nixbot[3856]: INFO: ::ffff:127.0.0.1:50490 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2025gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.04 seconds)2026gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2027gitlab # [ 400.918126] nixbot[3856]: INFO: ::ffff:127.0.0.1:54508 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2028gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.08 seconds)2029gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2030gitlab # [ 401.995432] nixbot[3856]: INFO: ::ffff:127.0.0.1:54516 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2031gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2032gitlab # [ 402.706147] nix-daemon[4116]: accepted connection from pid 4139, user nixbot2033gitlab # [ 402.746504] nix-daemon[4116]: accepted connection from pid 4111, user nixbot2034gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2035gitlab # [ 403.039117] nixbot[3856]: INFO: ::ffff:127.0.0.1:54532 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2036gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.04 seconds)2037gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2038gitlab # [ 404.096776] nixbot[3856]: INFO: ::ffff:127.0.0.1:54544 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2039gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2040gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2041gitlab # [ 405.151915] nixbot[3856]: INFO: ::ffff:127.0.0.1:54552 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2042gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2043gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2044gitlab # [ 406.209846] nixbot[3856]: INFO: ::ffff:127.0.0.1:54560 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2045gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2046gitlab # [ 407.058671] nix-daemon[4116]: accepted connection from pid 4111, user nixbot2047gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2048gitlab # [ 407.304678] nixbot[3856]: INFO: ::ffff:127.0.0.1:54576 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2049gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.09 seconds)2050gitlab # [ 407.459469] gitaly[896]: time="2026-09-04T07:31:09.345Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN86QXN1T81Q9C2K374C4D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:31:39.043" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:31:09.344" grpc.time_ms=0.768 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2051gitlab # [ 407.776865] gitaly[896]: time="2026-09-04T07:31:09.662Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=7 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN86QXN1T81Q9C2K374C4D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:31:19.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:31:09.645" grpc.time_ms=16.802 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2052gitlab # [ 408.088326] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:31:09 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e8a33ab956c0696d86aed7fb4ce82a7e2b45986f HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 7922053gitlab # [ 408.093415] nixbot[3856]: {"ts": "2026-09-04T07:31:09.975Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e8a33ab956c0696d86aed7fb4ce82a7e2b45986f \"HTTP/1.1 201 Created\""}2054gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2055gitlab # [ 408.337639] nixbot[3856]: INFO: ::ffff:127.0.0.1:54578 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2056gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.03 seconds)2057gitlab # [ 408.469926] gitaly[896]: time="2026-09-04T07:31:10.355Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN87GXXKNGZM1QGHC3E1MS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:31:40.053" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:31:10.354" grpc.time_ms=1.07 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2058gitlab # [ 408.549869] gitaly[896]: time="2026-09-04T07:31:10.435Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1NN87GXXKNGZM1QGHC3E1MS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:31:20.222" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:31:10.423" grpc.time_ms=12.645 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2059gitlab # [ 408.687946] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:31:10 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e8a33ab956c0696d86aed7fb4ce82a7e2b45986f HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 5922060gitlab # [ 408.696131] nixbot[3856]: {"ts": "2026-09-04T07:31:10.579Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e8a33ab956c0696d86aed7fb4ce82a7e2b45986f \"HTTP/1.1 201 Created\""}2061gitlab # [ 408.828918] gitaly[896]: time="2026-09-04T07:31:10.714Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN884E15N3JXBAXC9ZV9KM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:31:40.312" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:31:10.713" grpc.time_ms=1.057 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2062gitlab # [ 408.920280] gitaly[896]: time="2026-09-04T07:31:10.806Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN884E15N3JXBAXC9ZV9KM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:31:20.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:31:10.793" grpc.time_ms=13.091 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2063gitlab # [ 409.073394] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:31:10 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e8a33ab956c0696d86aed7fb4ce82a7e2b45986f HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 3462064gitlab # [ 409.076246] nixbot[3856]: {"ts": "2026-09-04T07:31:10.954Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e8a33ab956c0696d86aed7fb4ce82a7e2b45986f \"HTTP/1.1 201 Created\""}2065gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2066gitlab # [ 409.388287] nixbot[3856]: INFO: ::ffff:127.0.0.1:54592 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2067gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2068gitlab # [ 409.536985] gitaly[896]: time="2026-09-04T07:31:11.421Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=4 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN88T5J3GFZP5DKW63B55Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:31:11.399" grpc.time_ms=21.37 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2069gitlab # [ 409.560473] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:31:11 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1202070gitlab # [ 409.677890] gitaly[896]: time="2026-09-04T07:31:11.563Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN88Y0R6YZA2VEMNTB77KA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:31:11.544" pid=896 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2071gitlab # [ 409.692855] gitaly[896]: time="2026-09-04T07:31:11.563Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=8 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN88Y0R6YZA2VEMNTB77KA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:31:11.544" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2072gitlab # [ 409.711079] gitlab-workhorse[816]: time="2026-09-04T07:31:11Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672073gitlab # [ 409.716459] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:31:11 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1402074gitlab # [ 409.718828] gitaly[896]: time="2026-09-04T07:31:11.564Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=8 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN88Y0R6YZA2VEMNTB77KA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:31:11.544" grpc.time_ms=19.523 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2075gitlab # [ 409.828307] gitaly[896]: time="2026-09-04T07:31:11.712Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN892FN6H2X207ZVSD081M grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:31:11.678" pid=896 remote_ip="2001:db8:1::1" request_sha=ac5f574e3c743497cbfca4e0c8c1f6c200b3e839 response_bytes=337 span.kind=server system=grpc2076gitlab # [ 409.850860] gitlab-workhorse[816]: time="2026-09-04T07:31:11Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3372077gitlab # [ 409.855017] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:31:11 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 1462078gitlab # [ 409.865945] gitaly[896]: time="2026-09-04T07:31:11.712Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1130 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=4 command.system_time_ms=12 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN892FN6H2X207ZVSD081M grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:31:11.678" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2079gitlab # [ 409.892731] gitaly[896]: time="2026-09-04T07:31:11.714Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1130 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=4 command.system_time_ms=12 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN892FN6H2X207ZVSD081M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:31:11.678" grpc.time_ms=34.49 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2080gitlab # [ 410.090251] gitaly[896]: time="2026-09-04T07:31:11.976Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=8 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN89AZ2BT3AAFJF26DV60V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:31:11.956" grpc.time_ms=19.331 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2081gitlab # [ 410.110971] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:31:11 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1372082gitlab # [ 410.257316] gitaly[896]: time="2026-09-04T07:31:12.143Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN89FY1HZF6HP9TZA9A1RC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:31:12.121" pid=896 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc2083gitlab # [ 410.280333] gitaly[896]: time="2026-09-04T07:31:12.143Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=9 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN89FY1HZF6HP9TZA9A1RC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:31:12.121" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2084gitlab # [ 410.301524] gitlab-workhorse[816]: time="2026-09-04T07:31:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672085gitlab # [ 410.305197] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:31:12 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1462086gitlab # [ 410.308331] gitaly[896]: time="2026-09-04T07:31:12.143Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=9 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN89FY1HZF6HP9TZA9A1RC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:31:12.121" grpc.time_ms=22.22 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2087gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2088gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2089gitlab # [ 410.448346] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:31:12 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1182090gitlab # [ 410.455810] gitaly[896]: time="2026-09-04T07:31:12.333Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN89PNNC2XA1YMP5DVATW4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:31:12.306" grpc.time_ms=23.17 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2091gitlab # [ 410.480519] nixbot[3856]: INFO: ::ffff:127.0.0.1:54600 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2092gitlab # [ 410.615341] gitaly[896]: time="2026-09-04T07:31:12.500Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN89TSDRXHZ5A4KANV9M8H grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:31:12.462" pid=896 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2093gitlab # [ 410.639872] gitaly[896]: time="2026-09-04T07:31:12.500Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=35 command.spawn_token_fork_ms=11 command.system_time_ms=10 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN89TSDRXHZ5A4KANV9M8H grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:31:12.462" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2094gitlab # [ 410.665917] gitlab-workhorse[816]: time="2026-09-04T07:31:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162095gitlab # [ 410.669295] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:31:12 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 1552096gitlab # [ 410.672361] gitaly[896]: time="2026-09-04T07:31:12.501Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=35 command.spawn_token_fork_ms=11 command.system_time_ms=10 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN89TSDRXHZ5A4KANV9M8H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:31:12.462" grpc.time_ms=38.573 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2097gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2098gitlab # [ 411.489856] nixbot[3856]: INFO: ::ffff:127.0.0.1:46130 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2099gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2100gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2101gitlab # [ 412.547569] nixbot[3856]: INFO: ::ffff:127.0.0.1:46142 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2102gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2103gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2104gitlab # [ 413.649860] nixbot[3856]: INFO: ::ffff:127.0.0.1:46146 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2105gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.10 seconds)2106gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2107gitlab # [ 414.701671] nixbot[3856]: INFO: ::ffff:127.0.0.1:46148 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2108gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2109gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2110gitlab # [ 415.744329] nixbot[3856]: INFO: ::ffff:127.0.0.1:46152 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2111gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2112gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2113gitlab # [ 416.820957] nixbot[3856]: INFO: ::ffff:127.0.0.1:46166 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2114gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.09 seconds)2115gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2116gitlab # [ 417.906690] nixbot[3856]: INFO: ::ffff:127.0.0.1:46174 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2117gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.07 seconds)2118gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2119gitlab # [ 418.970389] nixbot[3856]: INFO: ::ffff:127.0.0.1:46180 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2120gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.07 seconds)2121gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2122gitlab # [ 420.025261] nixbot[3856]: INFO: ::ffff:127.0.0.1:46196 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2123gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2124gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2125gitlab # [ 421.079348] nixbot[3856]: INFO: ::ffff:127.0.0.1:57126 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2126gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2127gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2128gitlab # [ 422.150376] nixbot[3856]: INFO: ::ffff:127.0.0.1:57136 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2129gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.07 seconds)2130gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2131gitlab # [ 423.218472] nixbot[3856]: INFO: ::ffff:127.0.0.1:57140 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2132gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.07 seconds)2133gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2134gitlab # [ 424.262400] nixbot[3856]: INFO: ::ffff:127.0.0.1:57142 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2135gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.03 seconds)2136gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2137gitlab # [ 425.312930] nixbot[3856]: INFO: ::ffff:127.0.0.1:57158 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2138gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2139gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2140gitlab # [ 426.373781] nixbot[3856]: INFO: ::ffff:127.0.0.1:57160 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2141gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2142gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2143gitlab # [ 427.450695] nixbot[3856]: INFO: ::ffff:127.0.0.1:57162 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2144gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.07 seconds)2145gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2146gitlab # [ 428.504398] nixbot[3856]: INFO: ::ffff:127.0.0.1:57168 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2147gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2148gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2149gitlab # [ 429.553806] nixbot[3856]: INFO: ::ffff:127.0.0.1:57172 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2150gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2151gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2152gitlab # [ 430.599292] nixbot[3856]: INFO: ::ffff:127.0.0.1:57188 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2153gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.04 seconds)2154gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2155gitlab # [ 431.642052] nixbot[3856]: INFO: ::ffff:127.0.0.1:59654 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2156gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2157gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2158gitlab # [ 432.703718] nixbot[3856]: INFO: ::ffff:127.0.0.1:59658 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2159gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2160gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2161gitlab # [ 433.753655] nixbot[3856]: INFO: ::ffff:127.0.0.1:59664 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2162gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2163gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2164gitlab # [ 434.816748] nixbot[3856]: INFO: ::ffff:127.0.0.1:59672 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2165gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2166gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2167gitlab # [ 435.865587] nixbot[3856]: INFO: ::ffff:127.0.0.1:59676 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2168gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2169gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2170gitlab # [ 436.946394] nixbot[3856]: INFO: ::ffff:127.0.0.1:59684 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2171gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.08 seconds)2172gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2173gitlab # [ 437.997978] nixbot[3856]: INFO: ::ffff:127.0.0.1:59686 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2174gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2175gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2176gitlab # [ 439.053726] nixbot[3856]: INFO: ::ffff:127.0.0.1:59688 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2177gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2178gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2179gitlab # [ 440.095398] nixbot[3856]: INFO: ::ffff:127.0.0.1:59698 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2180gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2181gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2182gitlab # [ 441.145669] nixbot[3856]: INFO: ::ffff:127.0.0.1:53758 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2183gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2184gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2185gitlab # [ 442.221442] nixbot[3856]: INFO: ::ffff:127.0.0.1:53766 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2186gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2187gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2188gitlab # [ 443.259927] nixbot[3856]: INFO: ::ffff:127.0.0.1:53768 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2189gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.04 seconds)2190gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2191gitlab # [ 444.304837] nixbot[3856]: INFO: ::ffff:127.0.0.1:53784 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2192gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2193gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2194gitlab # [ 445.344186] nixbot[3856]: INFO: ::ffff:127.0.0.1:53794 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2195gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.04 seconds)2196gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2197gitlab # [ 446.390104] nixbot[3856]: INFO: ::ffff:127.0.0.1:53806 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2198gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.04 seconds)2199gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2200gitlab # [ 447.436703] nixbot[3856]: INFO: ::ffff:127.0.0.1:53820 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2201gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2202gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2203gitlab # [ 448.496413] nixbot[3856]: INFO: ::ffff:127.0.0.1:53834 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2204gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2205gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2206gitlab # [ 449.567118] nixbot[3856]: INFO: ::ffff:127.0.0.1:53846 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2207gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.07 seconds)2208gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2209gitlab # [ 450.612251] nixbot[3856]: INFO: ::ffff:127.0.0.1:53848 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2210gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2211gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2212gitlab # [ 451.677697] nixbot[3856]: INFO: ::ffff:127.0.0.1:56336 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2213gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2214gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2215gitlab # [ 452.743176] nixbot[3856]: INFO: ::ffff:127.0.0.1:56348 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2216gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.07 seconds)2217gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2218gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2219gitlab # [ 453.800397] nixbot[3856]: INFO: ::ffff:127.0.0.1:56360 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2220gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2221gitlab # [ 454.849445] nixbot[3856]: INFO: ::ffff:127.0.0.1:56370 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2222gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2223gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2224gitlab # [ 455.917146] nixbot[3856]: INFO: ::ffff:127.0.0.1:56384 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2225gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2226gitlab # [ 456.643444] sidekiq-cluster[3873]: 2026-09-04T07:31:58.528Z pid=3873 tid=ya1 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3873, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>431276032}2227gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2228gitlab # [ 456.961452] nixbot[3856]: INFO: ::ffff:127.0.0.1:56396 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2229gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2230gitlab # [ 457.131407] sidekiq-cluster[3873]: W, [2026-09-04T07:31:59.017245 #3873] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.2231gitlab # [ 457.264816] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:31:59.149Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}2232gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2233gitlab # [ 458.016346] nixbot[3856]: INFO: ::ffff:127.0.0.1:56412 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2234gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2235gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2236gitlab # [ 459.076973] nixbot[3856]: INFO: ::ffff:127.0.0.1:56422 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2237gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2238gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2239gitlab # [ 460.129394] nixbot[3856]: INFO: ::ffff:127.0.0.1:56428 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2240gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2241gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2242gitlab # [ 461.169344] nixbot[3856]: INFO: ::ffff:127.0.0.1:39754 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2243gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.04 seconds)2244gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2245gitlab # [ 462.214685] nixbot[3856]: INFO: ::ffff:127.0.0.1:39768 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2246gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.04 seconds)2247gitlab # [ 462.379936] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:32:04.265Z","message":"GitLab reliable fetch activated!"}2248gitlab # [ 462.384063] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:32:04.265Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2249gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2250gitlab # [ 463.259454] nixbot[3856]: INFO: ::ffff:127.0.0.1:39774 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2251gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2252gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2253gitlab # [ 464.298803] nixbot[3856]: INFO: ::ffff:127.0.0.1:39776 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2254gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.04 seconds)2255gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2256gitlab # [ 465.352717] nixbot[3856]: INFO: ::ffff:127.0.0.1:39790 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2257gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2258gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2259gitlab # [ 466.411467] nixbot[3856]: INFO: ::ffff:127.0.0.1:39792 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2260gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2261gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2262gitlab # [ 467.457243] nixbot[3856]: INFO: ::ffff:127.0.0.1:39808 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2263gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.04 seconds)2264gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2265gitlab # [ 468.513365] nixbot[3856]: INFO: ::ffff:127.0.0.1:39824 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2266gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2267gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2268gitlab # [ 469.555132] nixbot[3856]: INFO: ::ffff:127.0.0.1:39826 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2269gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2270gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2271gitlab # [ 470.635201] nixbot[3856]: INFO: ::ffff:127.0.0.1:39828 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2272gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2273gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2274gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2275gitlab # [ 471.693454] nixbot[3856]: INFO: ::ffff:127.0.0.1:53756 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2276gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2277gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2278gitlab # [ 472.751119] nixbot[3856]: INFO: ::ffff:127.0.0.1:53770 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2279gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2280gitlab # [ 473.795851] nixbot[3856]: INFO: ::ffff:127.0.0.1:53776 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2281gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2282gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2283gitlab # [ 474.841168] nixbot[3856]: INFO: ::ffff:127.0.0.1:53778 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2284gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.04 seconds)2285gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2286gitlab # [ 475.880160] nixbot[3856]: INFO: ::ffff:127.0.0.1:53780 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2287gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2288gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2289gitlab # [ 476.941305] nixbot[3856]: INFO: ::ffff:127.0.0.1:53792 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2290gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2291gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2292gitlab # [ 477.997894] nixbot[3856]: INFO: ::ffff:127.0.0.1:53806 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2293gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2294gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2295gitlab # [ 479.048153] nixbot[3856]: INFO: ::ffff:127.0.0.1:53822 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2296gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2297gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2298gitlab # [ 480.130363] nixbot[3856]: INFO: ::ffff:127.0.0.1:53830 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2299gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.09 seconds)2300gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2301gitlab # [ 481.187644] nixbot[3856]: INFO: ::ffff:127.0.0.1:56146 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2302gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2303gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2304gitlab # [ 482.237359] nixbot[3856]: INFO: ::ffff:127.0.0.1:56152 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2305gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.05 seconds)2306gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2307gitlab # [ 483.308318] nixbot[3856]: INFO: ::ffff:127.0.0.1:56164 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2308gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2309gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2310gitlab # [ 484.373189] nixbot[3856]: INFO: ::ffff:127.0.0.1:56168 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2311gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2312gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2313gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2314gitlab # [ 485.432760] nixbot[3856]: INFO: ::ffff:127.0.0.1:56174 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2315gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2316gitlab # [ 486.484982] nixbot[3856]: INFO: ::ffff:127.0.0.1:56186 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2317gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2318gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2319gitlab # [ 487.546795] nixbot[3856]: INFO: ::ffff:127.0.0.1:56202 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2320gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2321gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2322gitlab # [ 488.604956] nixbot[3856]: INFO: ::ffff:127.0.0.1:56210 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2323gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2324gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2325gitlab # [ 489.680788] nixbot[3856]: INFO: ::ffff:127.0.0.1:56214 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2326gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.07 seconds)2327gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2328gitlab # [ 490.747280] nixbot[3856]: INFO: ::ffff:127.0.0.1:56226 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2329gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.07 seconds)2330gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2331gitlab # [ 491.814276] nixbot[3856]: INFO: ::ffff:127.0.0.1:53652 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2332gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2333gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2334gitlab # [ 492.876317] nixbot[3856]: INFO: ::ffff:127.0.0.1:53666 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2335gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2336gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2337gitlab # [ 493.941636] nixbot[3856]: INFO: ::ffff:127.0.0.1:53674 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2338gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.07 seconds)2339gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2340gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2341gitlab # [ 495.006122] nixbot[3856]: INFO: ::ffff:127.0.0.1:53680 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2342gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2343gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2344gitlab # [ 496.071458] nixbot[3856]: INFO: ::ffff:127.0.0.1:53694 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2345gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2346gitlab # [ 497.135020] nixbot[3856]: INFO: ::ffff:127.0.0.1:53710 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2347gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.07 seconds)2348gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2349gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.07 seconds)2350gitlab # [ 498.205911] nixbot[3856]: INFO: ::ffff:127.0.0.1:53724 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2351gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2352gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.07 seconds)2353gitlab # [ 499.274385] nixbot[3856]: INFO: ::ffff:127.0.0.1:53738 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2354gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2355gitlab # [ 500.341741] nixbot[3856]: INFO: ::ffff:127.0.0.1:53744 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2356gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.07 seconds)2357gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2358gitlab # [ 501.404262] nixbot[3856]: INFO: ::ffff:127.0.0.1:49634 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2359gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2360gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2361gitlab # [ 502.473503] nixbot[3856]: INFO: ::ffff:127.0.0.1:49648 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2362gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.07 seconds)2363gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2364gitlab # [ 503.539071] nixbot[3856]: INFO: ::ffff:127.0.0.1:49652 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2365gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.07 seconds)2366gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2367gitlab # [ 504.606470] nixbot[3856]: INFO: ::ffff:127.0.0.1:49654 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2368gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.07 seconds)2369gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2370gitlab # [ 505.673938] nixbot[3856]: INFO: ::ffff:127.0.0.1:49662 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2371gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.07 seconds)2372gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2373gitlab # [ 506.740814] nixbot[3856]: INFO: ::ffff:127.0.0.1:49664 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2374gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.07 seconds)2375gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2376gitlab # [ 507.804780] nixbot[3856]: INFO: ::ffff:127.0.0.1:49668 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2377gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2378gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2379gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2380gitlab # [ 508.867419] nixbot[3856]: INFO: ::ffff:127.0.0.1:49678 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2381gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2382gitlab # [ 509.927801] nixbot[3856]: INFO: ::ffff:127.0.0.1:49684 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2383gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2384gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2385gitlab # [ 510.993157] nixbot[3856]: INFO: ::ffff:127.0.0.1:52706 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2386gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2387gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2388gitlab # [ 512.054470] nixbot[3856]: INFO: ::ffff:127.0.0.1:52716 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2389gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2390gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2391gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2392gitlab # [ 513.115210] nixbot[3856]: INFO: ::ffff:127.0.0.1:52722 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2393gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2394gitlab # [ 514.173182] nixbot[3856]: INFO: ::ffff:127.0.0.1:52736 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2395gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2396gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2397gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2398gitlab # [ 515.236605] nixbot[3856]: INFO: ::ffff:127.0.0.1:52738 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2399gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2400gitlab # [ 516.299540] nixbot[3856]: INFO: ::ffff:127.0.0.1:52742 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2401gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2402gitlab # [ 517.216299] postgres[4593]: [4593] ERROR: relation "table_without_models" does not exist2403gitlab # [ 517.217740] postgres[4593]: [4593] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2404gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5'2405gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5', in 0.06 seconds)2406gitlab # [ 517.361485] nixbot[3856]: INFO: ::ffff:127.0.0.1:52756 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK2407gitlab # [ 517.448697] runuser[4622]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)2408gitlab # Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions2409gitlab # Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions2410gitlab # Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions2411gitlab # Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions2412gitlab # Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions2413gitlab # Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions2414gitlab # [ 522.661587] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:04.544Z","message":"Booted Rails 7.2.3.1 application in production environment"}2415gitlab # [ 522.662103] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:04.546Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}2416gitlab # [ 522.662276] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:04.546Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2417gitlab # [ 522.662396] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:04.546Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2418gitlab # [ 522.685494] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:04.549Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2419gitlab # [ 525.706422] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:07.590Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"8bcc68680d650b3a16cf8e5d","created_at":"2026-09-04T07:30:40.716Z","trace_propagation_headers":{"sentry-trace":"c66e8a25f49746fcb08621e6123fd64e-26a14bf76afe4d3d","baggage":"sentry-trace_id=c66e8a25f49746fcb08621e6123fd64e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NN78NHXB227T4G0Z8ZFD30","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:40.785Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-8bcc68680d650b3a16cf8e5d: start","job_status":"start","queue_duration_s":146.805145,"scheduling_latency_s":146.805299}2420gitlab # [ 526.071739] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:07.956Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"8bcc68680d650b3a16cf8e5d","created_at":"2026-09-04T07:30:40.716Z","trace_propagation_headers":{"sentry-trace":"c66e8a25f49746fcb08621e6123fd64e-26a14bf76afe4d3d","baggage":"sentry-trace_id=c66e8a25f49746fcb08621e6123fd64e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NN78NHXB227T4G0Z8ZFD30","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:40.785Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-8bcc68680d650b3a16cf8e5d: done: 0.366666 sec","job_status":"done","queue_duration_s":146.805145,"scheduling_latency_s":146.805299,"redis_calls":23,"redis_duration_s":0.010189,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.004841,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003098,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00225,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.170923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.189494,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.366666,"completed_at":"2026-09-04T07:33:07.956Z","load_balancing_strategy":"primary","db_duration_s":0.113818,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2421gitlab # [ 526.166160] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:07.960Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"b2528fed617e13305f52ffe1","created_at":"2026-09-04T07:30:40.803Z","trace_propagation_headers":{"sentry-trace":"c66e8a25f49746fcb08621e6123fd64e-26a14bf76afe4d3d","baggage":"sentry-trace_id=c66e8a25f49746fcb08621e6123fd64e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NN78NHXB227T4G0Z8ZFD30","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:40.819Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-b2528fed617e13305f52ffe1: start","job_status":"start","queue_duration_s":147.140678,"scheduling_latency_s":147.140725}2422gitlab # [ 526.278806] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:08.164Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"b2528fed617e13305f52ffe1","created_at":"2026-09-04T07:30:40.803Z","trace_propagation_headers":{"sentry-trace":"c66e8a25f49746fcb08621e6123fd64e-26a14bf76afe4d3d","baggage":"sentry-trace_id=c66e8a25f49746fcb08621e6123fd64e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NN78NHXB227T4G0Z8ZFD30","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:40.819Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-b2528fed617e13305f52ffe1: done: 0.203881 sec","job_status":"done","queue_duration_s":147.140678,"scheduling_latency_s":147.140725,"redis_calls":14,"redis_duration_s":0.005974,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001154,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002946,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001874,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.149008,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.15538738,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.203881,"completed_at":"2026-09-04T07:33:08.163Z","load_balancing_strategy":"primary","db_duration_s":0.043025,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2423gitlab # [ 526.371901] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:08.167Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"9b1d065f7766c6b226b3ff6e","created_at":"2026-09-04T07:30:42.068Z","trace_propagation_headers":{"sentry-trace":"c66e8a25f49746fcb08621e6123fd64e-26a14bf76afe4d3d","baggage":"sentry-trace_id=c66e8a25f49746fcb08621e6123fd64e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NN78NHXB227T4G0Z8ZFD30","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:42.087Z","job_size_bytes":5,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-9b1d065f7766c6b226b3ff6e: start","job_status":"start","queue_duration_s":146.080247,"scheduling_latency_s":146.080294}2424gitlab # [ 526.603692] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:08.488Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"9b1d065f7766c6b226b3ff6e","created_at":"2026-09-04T07:30:42.068Z","trace_propagation_headers":{"sentry-trace":"c66e8a25f49746fcb08621e6123fd64e-26a14bf76afe4d3d","baggage":"sentry-trace_id=c66e8a25f49746fcb08621e6123fd64e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NN78NHXB227T4G0Z8ZFD30","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:42.087Z","job_size_bytes":5,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-9b1d065f7766c6b226b3ff6e: done: 0.321462 sec","job_status":"done","queue_duration_s":146.080247,"scheduling_latency_s":146.080294,"redis_calls":12,"redis_duration_s":0.005261,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001202,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003234,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000825,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.254764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00085004,"duration_s":0.321462,"completed_at":"2026-09-04T07:33:08.488Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.056092,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2425gitlab # [ 526.692399] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:08.492Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"3646ee90d99957f54616778c","created_at":"2026-09-04T07:30:42.159Z","trace_propagation_headers":{"sentry-trace":"c66e8a25f49746fcb08621e6123fd64e-26a14bf76afe4d3d","baggage":"sentry-trace_id=c66e8a25f49746fcb08621e6123fd64e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NN78NHXB227T4G0Z8ZFD30","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:42.175Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-3646ee90d99957f54616778c: start","job_status":"start","queue_duration_s":146.317128,"scheduling_latency_s":146.317177}2426gitlab # [ 527.162156] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:09.046Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"3646ee90d99957f54616778c","created_at":"2026-09-04T07:30:42.159Z","trace_propagation_headers":{"sentry-trace":"c66e8a25f49746fcb08621e6123fd64e-26a14bf76afe4d3d","baggage":"sentry-trace_id=c66e8a25f49746fcb08621e6123fd64e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NN78NHXB227T4G0Z8ZFD30","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:42.175Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-3646ee90d99957f54616778c: done: 0.553934 sec","job_status":"done","queue_duration_s":146.317128,"scheduling_latency_s":146.317177,"redis_calls":11,"redis_duration_s":0.017663,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.003133,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.011525,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003005,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":36,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.071,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.455,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.455,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.068,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.393301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00090972,"duration_s":0.553934,"completed_at":"2026-09-04T07:33:09.045Z","load_balancing_strategy":"primary","db_duration_s":0.163266,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2427gitlab # [ 527.259201] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:09.049Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"6b74eb98d835afc6652fce8a","created_at":"2026-09-04T07:30:42.180Z","trace_propagation_headers":{"sentry-trace":"c66e8a25f49746fcb08621e6123fd64e-26a14bf76afe4d3d","baggage":"sentry-trace_id=c66e8a25f49746fcb08621e6123fd64e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NN78NHXB227T4G0Z8ZFD30","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:42.203Z","job_size_bytes":89,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-6b74eb98d835afc6652fce8a: start","job_status":"start","queue_duration_s":146.846621,"scheduling_latency_s":146.846666}2428gitlab # [ 527.284049] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:09.128Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"6b74eb98d835afc6652fce8a","created_at":"2026-09-04T07:30:42.180Z","trace_propagation_headers":{"sentry-trace":"c66e8a25f49746fcb08621e6123fd64e-26a14bf76afe4d3d","baggage":"sentry-trace_id=c66e8a25f49746fcb08621e6123fd64e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NN78NHXB227T4G0Z8ZFD30","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:42.203Z","job_size_bytes":89,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-6b74eb98d835afc6652fce8a: done: 0.078905 sec","job_status":"done","queue_duration_s":146.846621,"scheduling_latency_s":146.846666,"redis_calls":11,"redis_duration_s":0.005013,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00123,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002632,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001151,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00083026,"duration_s":0.078905,"completed_at":"2026-09-04T07:33:09.128Z","load_balancing_strategy":"primary","db_duration_s":0.010916,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2429gitlab # [ 527.339787] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:09.132Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 e8a33ab956c0696d86aed7fb4ce82a7e2b45986f refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"b322ce7641849c900becf823","created_at":"2026-09-04T07:30:45.843Z","trace_propagation_headers":{"sentry-trace":"10749061cc9343b4adef3449910ff808-a5849e1430ba434b","baggage":"sentry-trace_id=10749061cc9343b4adef3449910ff808,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NN7ER63XE7NAN0J0KE5DX0","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:45.911Z","job_size_bytes":185,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-b322ce7641849c900becf823: start","job_status":"start","queue_duration_s":143.220955,"scheduling_latency_s":143.220994}2430gitlab # [ 527.356896] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:09.169Z","message":"changes: \"0000000000000000000000000000000000000000 e8a33ab956c0696d86aed7fb4ce82a7e2b45986f refs/heads/master\\n\""}2431gitlab # [ 527.364882] gitaly[896]: time="2026-09-04T07:33:09.250Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:33:19.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:09.237" grpc.time_ms=12.997 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2432gitlab # [ 527.388589] gitaly[896]: time="2026-09-04T07:33:09.274Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:33:19.029" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:33:09.259" grpc.time_ms=14.688 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2433gitlab # [ 527.484989] gitaly[896]: time="2026-09-04T07:33:09.370Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=7 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-04T07:33:19.119" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:09.349" grpc.time_ms=20.785 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2434gitlab # [ 527.587012] gitaly[896]: time="2026-09-04T07:33:09.473Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3937 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:33:09.472" grpc.time_ms=0.952 pid=896 span.kind=server system=grpc2435gitlab # [ 527.632201] gitaly[896]: time="2026-09-04T07:33:09.517Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3939 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:33:09.515" grpc.time_ms=2.11 pid=896 span.kind=server system=grpc2436gitlab # [ 527.668609] gitaly[896]: time="2026-09-04T07:33:09.554Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 diskcache=8c3fb4e5-79d3-4ae8-91cc-7f6ad315ecd2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:33:19.190" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:33:09.421" pid=896 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2437gitlab # [ 527.688694] gitaly[896]: time="2026-09-04T07:33:09.555Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=110 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4744 command.oublock=8 command.real_time_ms=124 command.spawn_token_fork_ms=1 command.system_time_ms=68 command.user_time_ms=42 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:33:19.190" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:33:09.421" grpc.time_ms=133.628 pid=896 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2438gitlab # [ 527.711026] gitaly[896]: time="2026-09-04T07:33:09.593Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:33:19.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:33:09.592" grpc.time_ms=0.444 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2439gitlab # [ 527.745464] gitaly[896]: time="2026-09-04T07:33:09.631Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=858 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=14 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-04T07:33:19.012" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:09.603" grpc.time_ms=27.38 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2440gitlab # [ 527.939325] gitaly[896]: time="2026-09-04T07:33:09.825Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=313 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-09-04T07:33:39.010" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:09.811" grpc.time_ms=13.747 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2441gitlab # [ 528.016811] gitaly[896]: time="2026-09-04T07:33:09.902Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T07:33:19.001" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:33:09.901" grpc.time_ms=0.713 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2442gitlab # [ 528.043293] gitaly[896]: time="2026-09-04T07:33:09.923Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=317 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-04T07:33:19.008" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-09-04T07:33:09.909" grpc.time_ms=13.714 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2443gitlab # [ 528.117393] gitaly[896]: time="2026-09-04T07:33:10.003Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=3 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:33:19.084" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:09.985" grpc.time_ms=17.716 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2444gitlab # [ 528.156523] gitaly[896]: time="2026-09-04T07:33:10.034Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:33:20.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:10.015" grpc.time_ms=19.382 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2445gitlab # [ 528.204718] gitaly[896]: time="2026-09-04T07:33:10.090Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=4 command.system_time_ms=20 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-04T07:33:40.062" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:10.063" grpc.time_ms=27.053 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2446gitlab # [ 528.942441] gitaly[896]: time="2026-09-04T07:33:10.828Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-04T07:33:20.235" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:10.825" grpc.time_ms=2.225 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2447gitlab # [ 529.027748] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:10.911Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 e8a33ab956c0696d86aed7fb4ce82a7e2b45986f refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"b322ce7641849c900becf823","created_at":"2026-09-04T07:30:45.843Z","trace_propagation_headers":{"sentry-trace":"10749061cc9343b4adef3449910ff808-a5849e1430ba434b","baggage":"sentry-trace_id=10749061cc9343b4adef3449910ff808,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NN7ER63XE7NAN0J0KE5DX0","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:45.911Z","job_size_bytes":185,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-b322ce7641849c900becf823: done: 1.779767 sec","job_status":"done","queue_duration_s":143.220955,"scheduling_latency_s":143.220994,"gitaly_calls":13,"gitaly_duration_s":0.381591,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.133044,"redis_read_bytes":2103,"redis_write_bytes":21751,"redis_cache_calls":15,"redis_cache_duration_s":0.007271,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.03393,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002582,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7839,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.008933,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.05886,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.021468,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.099,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.354,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.409,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.099,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.194469,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0018156,"exclusive_lock_hold_duration_s":0.05031438,"duration_s":1.779767,"completed_at":"2026-09-04T07:33:10.911Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.175309,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2448gitlab # [ 529.142960] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:10.915Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","e8a33ab956c0696d86aed7fb4ce82a7e2b45986f fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"4df3ef3503eabbe04ff903ab","created_at":"2026-09-04T07:30:58.265Z","trace_propagation_headers":{"sentry-trace":"bb83478b1f754f1c8126e8d21b5d52c3-b3cf56b412cb4040","baggage":"sentry-trace_id=bb83478b1f754f1c8126e8d21b5d52c3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NN7TRR78KHX0BDGKW9AFXT","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:58.270Z","job_size_bytes":185,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-4df3ef3503eabbe04ff903ab: start","job_status":"start","queue_duration_s":132.645294,"scheduling_latency_s":132.645338}2449gitlab # [ 529.167476] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:10.935Z","message":"changes: \"e8a33ab956c0696d86aed7fb4ce82a7e2b45986f fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 refs/heads/master\\n\""}2450gitlab # [ 529.170727] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:11.005Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"4d951f06d6e8bde2a332d0d9","created_at":"2026-09-04T07:33:11.002Z","trace_propagation_headers":{"sentry-trace":"bb83478b1f754f1c8126e8d21b5d52c3-15c9efa508164cac","baggage":"sentry-trace_id=bb83478b1f754f1c8126e8d21b5d52c3,sentry-release=Unknown"},"correlation_id":"01M1NN7TRR78KHX0BDGKW9AFXT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"66a5b60561906859aa1ad7b4","job_size_bytes":46,"pid":3873,"job_status":"deduplicated","message":"ProjectCacheWorker JID-4d951f06d6e8bde2a332d0d9: deduplicated: until executing","deduplication.type":"until executing"}2451gitlab # [ 529.188701] gitaly[896]: time="2026-09-04T07:33:10.979Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=5 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7TRR78KHX0BDGKW9AFXT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:33:20.061" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:10.962" grpc.time_ms=17.403 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2452gitlab # [ 529.203561] gitaly[896]: time="2026-09-04T07:33:10.998Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7TRR78KHX0BDGKW9AFXT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:33:20.086" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:33:10.987" grpc.time_ms=10.962 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2453gitlab # [ 529.217216] gitaly[896]: time="2026-09-04T07:33:11.039Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7TRR78KHX0BDGKW9AFXT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-04T07:33:21.016" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:11.026" grpc.time_ms=11.948 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2454gitlab # [ 529.231522] gitaly[896]: time="2026-09-04T07:33:11.061Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=597 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7TRR78KHX0BDGKW9AFXT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-09-04T07:33:41.046" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:11.047" grpc.time_ms=14.038 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2455gitlab # [ 529.247057] gitaly[896]: time="2026-09-04T07:33:11.089Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=319 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7TRR78KHX0BDGKW9AFXT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-04T07:33:21.069" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-09-04T07:33:11.080" grpc.time_ms=8.187 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2456gitlab # [ 529.260432] gitaly[896]: time="2026-09-04T07:33:11.116Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7TRR78KHX0BDGKW9AFXT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:33:21.092" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:11.104" grpc.time_ms=12.058 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2457gitlab # [ 529.524606] gitaly[896]: time="2026-09-04T07:33:11.410Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7TRR78KHX0BDGKW9AFXT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-04T07:33:21.006" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:11.407" grpc.time_ms=2.993 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2458gitlab # [ 529.575572] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:11.460Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","e8a33ab956c0696d86aed7fb4ce82a7e2b45986f fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"4df3ef3503eabbe04ff903ab","created_at":"2026-09-04T07:30:58.265Z","trace_propagation_headers":{"sentry-trace":"bb83478b1f754f1c8126e8d21b5d52c3-b3cf56b412cb4040","baggage":"sentry-trace_id=bb83478b1f754f1c8126e8d21b5d52c3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NN7TRR78KHX0BDGKW9AFXT","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:30:58.270Z","job_size_bytes":185,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-4df3ef3503eabbe04ff903ab: done: 0.544863 sec","job_status":"done","queue_duration_s":132.645294,"scheduling_latency_s":132.645338,"gitaly_calls":7,"gitaly_duration_s":0.109306,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.0331,"redis_read_bytes":500,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.003311,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001417,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004689,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.010392,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.013291,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.035,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.035,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.383405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0010015,"exclusive_lock_hold_duration_s":0.02993408,"duration_s":0.544863,"completed_at":"2026-09-04T07:33:11.460Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.203764,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2459gitlab # [ 529.639420] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:11.464Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"87333998ec0a1c7c58f28987","created_at":"2026-09-04T07:30:59.471Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-1d2e11c4084047f1","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:59.493Z","job_size_bytes":65,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-87333998ec0a1c7c58f28987: start","job_status":"start","queue_duration_s":131.971044,"scheduling_latency_s":131.9711}2460gitlab # [ 529.769001] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:11.654Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"87333998ec0a1c7c58f28987","created_at":"2026-09-04T07:30:59.471Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-1d2e11c4084047f1","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:59.493Z","job_size_bytes":65,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-87333998ec0a1c7c58f28987: done: 0.190104 sec","job_status":"done","queue_duration_s":131.971044,"scheduling_latency_s":131.9711,"redis_calls":16,"redis_duration_s":0.009736,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.006228,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002641,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000867,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.130351,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00071062,"duration_s":0.190104,"completed_at":"2026-09-04T07:33:11.654Z","load_balancing_strategy":"primary","db_duration_s":0.044179,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2461gitlab # [ 529.875243] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:11.656Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"057b5708a7549dda01f2a8c7","created_at":"2026-09-04T07:30:59.495Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-1d2e11c4084047f1","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:59.509Z","job_size_bytes":65,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-057b5708a7549dda01f2a8c7: start","job_status":"start","queue_duration_s":132.146789,"scheduling_latency_s":132.146822}2462gitlab # [ 529.959419] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:11.844Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"057b5708a7549dda01f2a8c7","created_at":"2026-09-04T07:30:59.495Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-1d2e11c4084047f1","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:59.509Z","job_size_bytes":65,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-057b5708a7549dda01f2a8c7: done: 0.188026 sec","job_status":"done","queue_duration_s":132.146789,"scheduling_latency_s":132.146822,"redis_calls":21,"redis_duration_s":0.007203,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.003245,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00212,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001838,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.05,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.038,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.112371,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00072554,"duration_s":0.188026,"completed_at":"2026-09-04T07:33:11.844Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.061753,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2463gitlab # [ 530.051962] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:11.849Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"fcb80dc694323ad6ca629a4a","created_at":"2026-09-04T07:30:59.798Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-1d2e11c4084047f1","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:59.813Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-fcb80dc694323ad6ca629a4a: start","job_status":"start","queue_duration_s":132.035653,"scheduling_latency_s":132.035711}2464gitlab # [ 530.337373] gitaly[896]: time="2026-09-04T07:33:12.222Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NN7WEM380H2A4Z9FJ9Y346 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:33:12.220" grpc.time_ms=1.815 pid=896 span.kind=server system=grpc2465gitlab # [ 530.390001] gitaly[896]: time="2026-09-04T07:33:12.275Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NN7WEM380H2A4Z9FJ9Y346 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:33:12.274" grpc.time_ms=1.185 pid=896 span.kind=server system=grpc2466gitlab # [ 530.436497] gitaly[896]: time="2026-09-04T07:33:12.322Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NN7WEM380H2A4Z9FJ9Y346 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:33:12.319" grpc.time_ms=2.553 pid=896 span.kind=server system=grpc2467gitlab # [ 530.455887] gitaly[896]: time="2026-09-04T07:33:12.336Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7WEM380H2A4Z9FJ9Y346 diskcache=820d6b92-f202-4e61-8c10-44405cd96c4e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:33:42.169" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:12.170" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2468gitlab # [ 530.474731] gitaly[896]: time="2026-09-04T07:33:12.337Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=163 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7073 command.oublock=0 command.real_time_ms=158 command.spawn_token_fork_ms=1 command.system_time_ms=82 command.user_time_ms=81 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7WEM380H2A4Z9FJ9Y346 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:33:42.169" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:12.170" grpc.time_ms=165.838 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2469gitlab # [ 530.690183] gitaly[896]: time="2026-09-04T07:33:12.576Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7WEM380H2A4Z9FJ9Y346 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:33:42.573" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:12.573" grpc.time_ms=2.072 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2470gitlab # [ 530.782234] gitaly[896]: time="2026-09-04T07:33:12.668Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7WEM380H2A4Z9FJ9Y346 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:33:42.665" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:12.666" grpc.time_ms=1.393 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2471gitlab # [ 530.831216] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:12.716Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"fcb80dc694323ad6ca629a4a","created_at":"2026-09-04T07:30:59.798Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-1d2e11c4084047f1","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:30:59.813Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-fcb80dc694323ad6ca629a4a: done: 0.866931 sec","job_status":"done","queue_duration_s":132.035653,"scheduling_latency_s":132.035711,"gitaly_calls":3,"gitaly_duration_s":0.184252,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.047349,"redis_read_bytes":457,"redis_write_bytes":27985,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002571,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002553,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.017048,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.007003,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14479,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.010039,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001004,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00103,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00353,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.106,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.05,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.058,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.051,"db_ci_duration_s":0.055,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.541125,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.70362098,"duration_s":0.866931,"completed_at":"2026-09-04T07:33:12.715Z","load_balancing_strategy":"primary","db_duration_s":0.127214,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2472gitlab # [ 530.920310] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:12.720Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"66a5b60561906859aa1ad7b4","created_at":"2026-09-04T07:33:09.279Z","trace_propagation_headers":{"sentry-trace":"10749061cc9343b4adef3449910ff808-5eedc663f4464335","baggage":"sentry-trace_id=10749061cc9343b4adef3449910ff808,sentry-release=Unknown"},"correlation_id":"01M1NN7ER63XE7NAN0J0KE5DX0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:09.306Z","job_size_bytes":46,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-66a5b60561906859aa1ad7b4: start","job_status":"start","queue_duration_s":3.413564,"scheduling_latency_s":3.413621}2473gitlab # [ 530.946759] gitaly[896]: time="2026-09-04T07:33:12.832Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-09-04T13:33:12.820" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:33:12.820" grpc.time_ms=11.026 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2474gitlab # [ 530.979121] gitaly[896]: time="2026-09-04T07:33:12.865Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-04T07:33:42.845" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:12.846" grpc.time_ms=18.316 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2475gitlab # [ 531.017446] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:12.903Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"66a5b60561906859aa1ad7b4","created_at":"2026-09-04T07:33:09.279Z","trace_propagation_headers":{"sentry-trace":"10749061cc9343b4adef3449910ff808-5eedc663f4464335","baggage":"sentry-trace_id=10749061cc9343b4adef3449910ff808,sentry-release=Unknown"},"correlation_id":"01M1NN7ER63XE7NAN0J0KE5DX0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:09.306Z","job_size_bytes":46,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-66a5b60561906859aa1ad7b4: done: 0.183068 sec","job_status":"done","queue_duration_s":3.413564,"scheduling_latency_s":3.413621,"gitaly_calls":2,"gitaly_duration_s":0.037551,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.010919,"redis_read_bytes":69,"redis_write_bytes":4887,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002187,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000786,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2115,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002322,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.004319,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001305,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.110062,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033918,"duration_s":0.183068,"completed_at":"2026-09-04T07:33:12.903Z","load_balancing_strategy":"primary","db_duration_s":0.020628,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2476gitlab # [ 531.088080] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:12.904Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"adde53a995fae398ba02d0f1","created_at":"2026-09-04T07:33:09.332Z","trace_propagation_headers":{"sentry-trace":"10749061cc9343b4adef3449910ff808-5eedc663f4464335","baggage":"sentry-trace_id=10749061cc9343b4adef3449910ff808,sentry-release=Unknown"},"correlation_id":"01M1NN7ER63XE7NAN0J0KE5DX0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:09.342Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-adde53a995fae398ba02d0f1: start","job_status":"start","queue_duration_s":3.562373,"scheduling_latency_s":3.562399}2477gitlab # [ 531.108104] gitaly[896]: time="2026-09-04T07:33:12.968Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 diskcache=0625237b-2d30-4be0-9902-609afa8109fb grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-04T13:33:12.933" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:12.934" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2478gitlab # [ 531.120492] gitaly[896]: time="2026-09-04T07:33:12.969Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1173 command.oublock=0 command.real_time_ms=42 command.spawn_token_fork_ms=9 command.system_time_ms=17 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-04T13:33:12.933" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:12.934" grpc.time_ms=34.97 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2479gitlab # [ 531.137649] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:13.021Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"adde53a995fae398ba02d0f1","created_at":"2026-09-04T07:33:09.332Z","trace_propagation_headers":{"sentry-trace":"10749061cc9343b4adef3449910ff808-5eedc663f4464335","baggage":"sentry-trace_id=10749061cc9343b4adef3449910ff808,sentry-release=Unknown"},"correlation_id":"01M1NN7ER63XE7NAN0J0KE5DX0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:09.342Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-adde53a995fae398ba02d0f1: done: 0.116696 sec","job_status":"done","queue_duration_s":3.562373,"scheduling_latency_s":3.562399,"gitaly_calls":1,"gitaly_duration_s":0.038346,"redis_calls":15,"redis_duration_s":0.004464,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000612,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001469,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000883,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.0015,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.016,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.028,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04786,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.08907385999999999,"duration_s":0.116696,"completed_at":"2026-09-04T07:33:13.021Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025983,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2480gitlab # [ 531.188695] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:13.023Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"6c48ba52cf0f332fe5f5fc74","created_at":"2026-09-04T07:33:09.581Z","trace_propagation_headers":{"sentry-trace":"10749061cc9343b4adef3449910ff808-5eedc663f4464335","baggage":"sentry-trace_id=10749061cc9343b4adef3449910ff808,sentry-release=Unknown"},"correlation_id":"01M1NN7ER63XE7NAN0J0KE5DX0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:09.586Z","job_size_bytes":23,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-6c48ba52cf0f332fe5f5fc74: start","job_status":"start","queue_duration_s":3.436994,"scheduling_latency_s":3.437022}2481gitlab # [ 531.206256] gitaly[896]: time="2026-09-04T07:33:13.071Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-04T07:33:43.059" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:13.060" grpc.time_ms=11.087 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2482gitlab # [ 531.220169] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:13.085Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"6c48ba52cf0f332fe5f5fc74","created_at":"2026-09-04T07:33:09.581Z","trace_propagation_headers":{"sentry-trace":"10749061cc9343b4adef3449910ff808-5eedc663f4464335","baggage":"sentry-trace_id=10749061cc9343b4adef3449910ff808,sentry-release=Unknown"},"correlation_id":"01M1NN7ER63XE7NAN0J0KE5DX0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:09.586Z","job_size_bytes":23,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-6c48ba52cf0f332fe5f5fc74: done: 0.061639 sec","job_status":"done","queue_duration_s":3.436994,"scheduling_latency_s":3.437022,"gitaly_calls":1,"gitaly_duration_s":0.014993,"redis_calls":16,"redis_duration_s":0.005510999999999999,"redis_read_bytes":52,"redis_write_bytes":2047,"redis_queues_calls":1,"redis_queues_duration_s":0.00052,"redis_queues_read_bytes":1,"redis_queues_write_bytes":978,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001479,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002449,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001063,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035131,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.061639,"completed_at":"2026-09-04T07:33:13.085Z","load_balancing_strategy":"primary","db_duration_s":0.005541,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2483gitlab # [ 531.265956] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:13.087Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"adbbbadc1eb0a1d289ecd581","created_at":"2026-09-04T07:33:10.559Z","trace_propagation_headers":{"sentry-trace":"10749061cc9343b4adef3449910ff808-5eedc663f4464335","baggage":"sentry-trace_id=10749061cc9343b4adef3449910ff808,sentry-release=Unknown"},"correlation_id":"01M1NN7ER63XE7NAN0J0KE5DX0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e5909083794e183d3907aefbc5779a5e0cafcc351448a0a4a8c64a2ea5a9f9ee","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:10.572Z","job_size_bytes":467,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-adbbbadc1eb0a1d289ecd581: start","job_status":"start","queue_duration_s":2.515494,"scheduling_latency_s":2.51553}2484gitlab # [ 531.283240] gitaly[896]: time="2026-09-04T07:33:13.126Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:33:43.124" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:13.125" grpc.time_ms=1.052 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2485gitlab # [ 531.296786] gitaly[896]: time="2026-09-04T07:33:13.148Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T07:33:23.119" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:13.130" grpc.time_ms=17.464 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2486gitlab # [ 531.411943] gitaly[896]: time="2026-09-04T07:33:13.297Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:33:43.295" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:13.295" grpc.time_ms=1.39 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2487gitlab # [ 531.428828] gitaly[896]: time="2026-09-04T07:33:13.314Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=147 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-04T07:33:43.306" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:13.307" grpc.time_ms=7.359 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2488gitlab # [ 531.625759] gitaly[896]: time="2026-09-04T07:33:13.511Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:33:23.091" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:13.492" grpc.time_ms=19.188 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2489gitlab # [ 532.355404] gitaly[896]: time="2026-09-04T07:33:14.241Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-04T07:33:44.212" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:14.212" grpc.time_ms=28.357 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2490gitlab # [ 532.401524] gitaly[896]: time="2026-09-04T07:33:14.262Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7ER63XE7NAN0J0KE5DX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-04T07:33:44.245" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:14.245" grpc.time_ms=16.718 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2491gitlab # [ 532.444360] sidekiq-cluster[3873]: {"severity":"WARN","time":"2026-09-04T07:33:14.329Z","class":"CreatePipelineWorker","correlation_id":"01M1NN7ER63XE7NAN0J0KE5DX0","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"e8a33ab956c0696d86aed7fb4ce82a7e2b45986f","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"e8a33ab956c0696d86aed7fb4ce82a7e2b45986f","ref":"refs/heads/master"},"retry":0}2492gitlab # [ 532.492588] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:14.339Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"adbbbadc1eb0a1d289ecd581","created_at":"2026-09-04T07:33:10.559Z","trace_propagation_headers":{"sentry-trace":"10749061cc9343b4adef3449910ff808-5eedc663f4464335","baggage":"sentry-trace_id=10749061cc9343b4adef3449910ff808,sentry-release=Unknown"},"correlation_id":"01M1NN7ER63XE7NAN0J0KE5DX0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e5909083794e183d3907aefbc5779a5e0cafcc351448a0a4a8c64a2ea5a9f9ee","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:10.572Z","job_size_bytes":467,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-adbbbadc1eb0a1d289ecd581: done: 1.251667 sec","job_status":"done","queue_duration_s":2.515494,"scheduling_latency_s":2.51553,"gitaly_calls":7,"gitaly_duration_s":0.144528,"redis_calls":51,"redis_duration_s":0.017926,"redis_read_bytes":169,"redis_write_bytes":4167,"redis_cache_calls":4,"redis_cache_duration_s":0.00192,"redis_cache_read_bytes":10,"redis_cache_write_bytes":342,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.007595,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0019,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.004944,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001567,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.052,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.044,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.018939,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000474,"duration_s":1.251667,"completed_at":"2026-09-04T07:33:14.339Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.094795,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2493gitlab # [ 532.561166] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:14.342Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"acee32f5-5c2b-42a4-b03a-3bf4cda962fc\"}"],"class":"WebHookWorker","jid":"696936a8dcdba2e884ba51b5","created_at":"2026-09-04T07:33:10.773Z","trace_propagation_headers":{"sentry-trace":"10749061cc9343b4adef3449910ff808-5eedc663f4464335","baggage":"sentry-trace_id=10749061cc9343b4adef3449910ff808,sentry-release=Unknown"},"correlation_id":"01M1NN7ER63XE7NAN0J0KE5DX0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1ac7d89fe1e48be9963d5798d9abf003b7dcac2ae3f6ccfa64a72207b2386872","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:10.782Z","job_size_bytes":1751,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-696936a8dcdba2e884ba51b5: start","job_status":"start","queue_duration_s":3.559177,"scheduling_latency_s":3.55921}2494gitlab # [ 532.660409] nixbot[3856]: INFO: ::ffff:127.0.0.1:47136 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2495gitlab # [ 532.704249] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:14.589Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"acee32f5-5c2b-42a4-b03a-3bf4cda962fc\"}"],"class":"WebHookWorker","jid":"696936a8dcdba2e884ba51b5","created_at":"2026-09-04T07:33:10.773Z","trace_propagation_headers":{"sentry-trace":"10749061cc9343b4adef3449910ff808-5eedc663f4464335","baggage":"sentry-trace_id=10749061cc9343b4adef3449910ff808,sentry-release=Unknown"},"correlation_id":"01M1NN7ER63XE7NAN0J0KE5DX0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1ac7d89fe1e48be9963d5798d9abf003b7dcac2ae3f6ccfa64a72207b2386872","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:10.782Z","job_size_bytes":1751,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-696936a8dcdba2e884ba51b5: done: 0.246964 sec","job_status":"done","queue_duration_s":3.559177,"scheduling_latency_s":3.55921,"redis_calls":19,"redis_duration_s":0.006967,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001849,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000577,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003026,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001515,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.050116819999971085,"cpu_s":0.172145,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00105838,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.246964,"completed_at":"2026-09-04T07:33:14.588Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005913,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2496gitlab # [ 532.760167] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:14.596Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"a0c86ae1b0c3cd992b3ceb5a","created_at":"2026-09-04T07:33:11.016Z","trace_propagation_headers":{"sentry-trace":"bb83478b1f754f1c8126e8d21b5d52c3-15c9efa508164cac","baggage":"sentry-trace_id=bb83478b1f754f1c8126e8d21b5d52c3,sentry-release=Unknown"},"correlation_id":"01M1NN7TRR78KHX0BDGKW9AFXT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"adde53a995fae398ba02d0f1","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:11.020Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-a0c86ae1b0c3cd992b3ceb5a: start","job_status":"start","queue_duration_s":3.575692,"scheduling_latency_s":3.575746}2497gitlab # [ 532.779262] gitaly[896]: time="2026-09-04T07:33:14.653Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7TRR78KHX0BDGKW9AFXT diskcache=249c225b-2802-4f63-9ff8-b6fce440485c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-04T13:33:14.639" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:14.640" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2498gitlab # [ 532.789460] gitaly[896]: time="2026-09-04T07:33:14.654Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=289 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7TRR78KHX0BDGKW9AFXT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-04T13:33:14.639" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:14.640" grpc.time_ms=13.153 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2499gitlab # [ 532.804256] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:14.680Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"a0c86ae1b0c3cd992b3ceb5a","created_at":"2026-09-04T07:33:11.016Z","trace_propagation_headers":{"sentry-trace":"bb83478b1f754f1c8126e8d21b5d52c3-15c9efa508164cac","baggage":"sentry-trace_id=bb83478b1f754f1c8126e8d21b5d52c3,sentry-release=Unknown"},"correlation_id":"01M1NN7TRR78KHX0BDGKW9AFXT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"adde53a995fae398ba02d0f1","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:11.020Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-a0c86ae1b0c3cd992b3ceb5a: done: 0.084719 sec","job_status":"done","queue_duration_s":3.575692,"scheduling_latency_s":3.575746,"gitaly_calls":1,"gitaly_duration_s":0.017127,"redis_calls":12,"redis_duration_s":0.008315,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002449,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.002413,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003453,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045993,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.04469914,"duration_s":0.084719,"completed_at":"2026-09-04T07:33:14.680Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011174,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2500gitlab # [ 532.851243] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:14.682Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"09d9da622669ac06cf46c263","created_at":"2026-09-04T07:33:11.192Z","trace_propagation_headers":{"sentry-trace":"bb83478b1f754f1c8126e8d21b5d52c3-15c9efa508164cac","baggage":"sentry-trace_id=bb83478b1f754f1c8126e8d21b5d52c3,sentry-release=Unknown"},"correlation_id":"01M1NN7TRR78KHX0BDGKW9AFXT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1cdc14e5fc6e66709c38fc3a5e0d30abd0c41b23c88fb04a1aa9c492c9f24afc","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:11.197Z","job_size_bytes":467,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-09d9da622669ac06cf46c263: start","job_status":"start","queue_duration_s":3.485865,"scheduling_latency_s":3.485898}2501gitlab # [ 532.869588] gitaly[896]: time="2026-09-04T07:33:14.720Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7TRR78KHX0BDGKW9AFXT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:33:44.718" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:14.719" grpc.time_ms=0.958 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2502gitlab # [ 532.882373] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:33:14 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1482503gitlab # [ 532.884598] gitaly[896]: time="2026-09-04T07:33:14.738Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=12 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN7TRR78KHX0BDGKW9AFXT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T07:33:24.003" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:14.724" grpc.time_ms=14.642 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2504gitlab # [ 532.897922] gitaly[896]: time="2026-09-04T07:33:14.746Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=7 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNC1760M05A9NFXJ2N2F1W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:33:14.734" grpc.time_ms=12.377 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2505gitlab # [ 532.912889] gitaly[896]: time="2026-09-04T07:33:14.798Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7TRR78KHX0BDGKW9AFXT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:33:44.797" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:14.797" grpc.time_ms=0.983 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2506gitlab # [ 532.928055] gitaly[896]: time="2026-09-04T07:33:14.814Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=6 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=6 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=294 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7TRR78KHX0BDGKW9AFXT error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-04T07:33:44.804" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:14.805" grpc.time_ms=8.958 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2507gitlab # [ 532.972622] gitaly[896]: time="2026-09-04T07:33:14.858Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7TRR78KHX0BDGKW9AFXT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:33:24.129" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:14.849" grpc.time_ms=9.27 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2508gitlab # [ 533.007129] gitaly[896]: time="2026-09-04T07:33:14.893Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNC1BXQK68W1Q1Z4J9TA8W grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:33:14.883" pid=896 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2509gitlab # [ 533.018952] gitaly[896]: time="2026-09-04T07:33:14.894Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNC1BXQK68W1Q1Z4J9TA8W grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:33:14.883" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2510gitlab # [ 533.035178] gitlab-workhorse[816]: time="2026-09-04T07:33:14Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672511gitlab # [ 533.037786] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:33:14 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1462512gitlab # [ 533.039758] gitaly[896]: time="2026-09-04T07:33:14.894Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNC1BXQK68W1Q1Z4J9TA8W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:33:14.883" grpc.time_ms=10.786 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2513gitlab # [ 533.058615] nixbot[3856]: {"ts": "2026-09-04T07:33:14.944Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2514gitlab # [ 533.170555] gitaly[896]: time="2026-09-04T07:33:15.056Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNC1JGWZTZ2JHTFG6WG4Z1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:33:45.053" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:15.054" grpc.time_ms=1.4 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2515gitlab # [ 533.272872] gitaly[896]: time="2026-09-04T07:33:15.158Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M1NNC1JGWZTZ2JHTFG6WG4Z1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:33:25.089" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:15.140" grpc.time_ms=18.022 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2516gitlab # [ 533.362727] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:33:15 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e8a33ab956c0696d86aed7fb4ce82a7e2b45986f HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 2872517gitlab # [ 533.371167] nixbot[3856]: {"ts": "2026-09-04T07:33:15.250Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e8a33ab956c0696d86aed7fb4ce82a7e2b45986f \"HTTP/1.1 201 Created\""}2518gitlab # [ 533.437970] gitaly[896]: time="2026-09-04T07:33:15.323Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNC1VPCMBPSE0RKK5RZR9Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:33:45.020" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:15.321" grpc.time_ms=1.612 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2519gitlab # [ 533.524903] gitaly[896]: time="2026-09-04T07:33:15.410Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNC1VPCMBPSE0RKK5RZR9Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:33:25.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:15.397" grpc.time_ms=13.338 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2520gitlab # [ 533.636120] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:33:15 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e8a33ab956c0696d86aed7fb4ce82a7e2b45986f HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2652521gitlab # [ 533.639022] nixbot[3856]: {"ts": "2026-09-04T07:33:15.522Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e8a33ab956c0696d86aed7fb4ce82a7e2b45986f \"HTTP/1.1 201 Created\""}2522gitlab # [ 533.723175] gitaly[896]: time="2026-09-04T07:33:15.609Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNC2485MXDJ5HJPW8HV0WA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:33:45.307" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:15.608" grpc.time_ms=0.786 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2523gitlab # [ 533.766736] gitaly[896]: time="2026-09-04T07:33:15.648Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7TRR78KHX0BDGKW9AFXT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-04T07:33:45.632" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:15.633" grpc.time_ms=14.758 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2524gitlab # [ 533.794504] gitaly[896]: time="2026-09-04T07:33:15.665Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=5 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN7TRR78KHX0BDGKW9AFXT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-04T07:33:45.651" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:15.651" grpc.time_ms=13.139 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2525gitlab # [ 533.814563] sidekiq-cluster[3873]: {"severity":"WARN","time":"2026-09-04T07:33:15.689Z","class":"CreatePipelineWorker","correlation_id":"01M1NN7TRR78KHX0BDGKW9AFXT","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"e8a33ab956c0696d86aed7fb4ce82a7e2b45986f","after":"fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5","ref":"refs/heads/master"},"retry":0}2526gitlab # [ 533.823767] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:15.697Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"09d9da622669ac06cf46c263","created_at":"2026-09-04T07:33:11.192Z","trace_propagation_headers":{"sentry-trace":"bb83478b1f754f1c8126e8d21b5d52c3-15c9efa508164cac","baggage":"sentry-trace_id=bb83478b1f754f1c8126e8d21b5d52c3,sentry-release=Unknown"},"correlation_id":"01M1NN7TRR78KHX0BDGKW9AFXT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1cdc14e5fc6e66709c38fc3a5e0d30abd0c41b23c88fb04a1aa9c492c9f24afc","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:11.197Z","job_size_bytes":467,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-09d9da622669ac06cf46c263: done: 1.014809 sec","job_status":"done","queue_duration_s":3.485865,"scheduling_latency_s":3.485898,"gitaly_calls":7,"gitaly_duration_s":0.090165,"redis_calls":33,"redis_duration_s":0.008175,"redis_read_bytes":185,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000826,"redis_cache_read_bytes":44,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001177,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.00522,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000952,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.895114,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.014809,"completed_at":"2026-09-04T07:33:15.697Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026056,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2527gitlab # [ 533.883361] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:15.699Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"717dca59-73d6-4b03-983b-e0d6b214645a\"}"],"class":"WebHookWorker","jid":"87ca1781c90fc44519fea8ab","created_at":"2026-09-04T07:33:11.220Z","trace_propagation_headers":{"sentry-trace":"bb83478b1f754f1c8126e8d21b5d52c3-15c9efa508164cac","baggage":"sentry-trace_id=bb83478b1f754f1c8126e8d21b5d52c3,sentry-release=Unknown"},"correlation_id":"01M1NN7TRR78KHX0BDGKW9AFXT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1e2c068a03aa771b6b4c2ee83be79fcd751a25f0ee8082c48bb3a0dbc90ac3eb","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:11.223Z","job_size_bytes":1749,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-87ca1781c90fc44519fea8ab: start","job_status":"start","queue_duration_s":4.476147,"scheduling_latency_s":4.476185}2528gitlab # [ 533.904266] nixbot[3856]: INFO: ::ffff:127.0.0.1:47150 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2529gitlab # [ 533.905760] gitaly[896]: time="2026-09-04T07:33:15.716Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=5 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NNC2485MXDJ5HJPW8HV0WA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:33:25.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:15.704" grpc.time_ms=12.352 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2530gitlab # [ 533.920163] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:15.771Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"717dca59-73d6-4b03-983b-e0d6b214645a\"}"],"class":"WebHookWorker","jid":"87ca1781c90fc44519fea8ab","created_at":"2026-09-04T07:33:11.220Z","trace_propagation_headers":{"sentry-trace":"bb83478b1f754f1c8126e8d21b5d52c3-15c9efa508164cac","baggage":"sentry-trace_id=bb83478b1f754f1c8126e8d21b5d52c3,sentry-release=Unknown"},"correlation_id":"01M1NN7TRR78KHX0BDGKW9AFXT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1e2c068a03aa771b6b4c2ee83be79fcd751a25f0ee8082c48bb3a0dbc90ac3eb","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:11.223Z","job_size_bytes":1749,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-87ca1781c90fc44519fea8ab: done: 0.071954 sec","job_status":"done","queue_duration_s":4.476147,"scheduling_latency_s":4.476185,"redis_calls":14,"redis_duration_s":0.005312,"redis_read_bytes":26,"redis_write_bytes":4683,"redis_queues_calls":2,"redis_queues_duration_s":0.0004,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3727,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0038,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001112,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.008714400000030764,"cpu_s":0.040104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.071954,"completed_at":"2026-09-04T07:33:15.771Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007726,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2531gitlab # [ 533.971097] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:15.777Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e4ede54e5464614a27500810","created_at":"2026-09-04T07:33:12.148Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-39cc6aada8644c4f","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:12.155Z","job_size_bytes":23,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e4ede54e5464614a27500810: start","job_status":"start","queue_duration_s":3.622552,"scheduling_latency_s":3.62259}2532gitlab # [ 533.988774] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:33:15 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e8a33ab956c0696d86aed7fb4ce82a7e2b45986f HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 3132533gitlab # [ 533.991412] nixbot[3856]: {"ts": "2026-09-04T07:33:15.843Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e8a33ab956c0696d86aed7fb4ce82a7e2b45986f \"HTTP/1.1 201 Created\""}2534gitlab # [ 534.026528] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:15.912Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e4ede54e5464614a27500810","created_at":"2026-09-04T07:33:12.148Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-39cc6aada8644c4f","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:12.155Z","job_size_bytes":23,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e4ede54e5464614a27500810: done: 0.134554 sec","job_status":"done","queue_duration_s":3.622552,"scheduling_latency_s":3.62259,"redis_calls":10,"redis_duration_s":0.006067,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001941,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002987,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001139,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.09003,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00172498,"duration_s":0.134554,"completed_at":"2026-09-04T07:33:15.912Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024618,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2535gitlab # [ 534.073003] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:15.915Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2c9ab7079ccd02b119f41fe0","created_at":"2026-09-04T07:33:12.345Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-39cc6aada8644c4f","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:12.355Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2c9ab7079ccd02b119f41fe0: start","job_status":"start","queue_duration_s":3.560103,"scheduling_latency_s":3.560132}2536gitlab # [ 534.090144] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:33:15 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1082537gitlab # [ 534.092294] gitaly[896]: time="2026-09-04T07:33:15.938Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNC2DPQTDAWBDFE5JQ2ACW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:33:15.923" grpc.time_ms=14.245 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2538gitlab # [ 534.105659] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:15.968Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2c9ab7079ccd02b119f41fe0","created_at":"2026-09-04T07:33:12.345Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-39cc6aada8644c4f","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:12.355Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2c9ab7079ccd02b119f41fe0: done: 0.053393 sec","job_status":"done","queue_duration_s":3.560103,"scheduling_latency_s":3.560132,"redis_calls":10,"redis_duration_s":0.005168,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000767,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003834,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000567,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033569,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036416,"duration_s":0.053393,"completed_at":"2026-09-04T07:33:15.968Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007734,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2539gitlab # [ 534.150645] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:15.970Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"49acb7f18d37f72697da72f5","created_at":"2026-09-04T07:33:12.377Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-39cc6aada8644c4f","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:12.391Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-49acb7f18d37f72697da72f5: start","job_status":"start","queue_duration_s":3.578604,"scheduling_latency_s":3.578635}2540gitlab # [ 534.166756] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:16.022Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"49acb7f18d37f72697da72f5","created_at":"2026-09-04T07:33:12.377Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-39cc6aada8644c4f","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:12.391Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-49acb7f18d37f72697da72f5: done: 0.052428 sec","job_status":"done","queue_duration_s":3.578604,"scheduling_latency_s":3.578635,"redis_calls":10,"redis_duration_s":0.005398,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000482,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003825,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001091,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034364,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00152028,"duration_s":0.052428,"completed_at":"2026-09-04T07:33:16.022Z","load_balancing_strategy":"primary","db_duration_s":0.006338,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2541gitlab # [ 534.213145] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:16.024Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"1c8cc171af2a2bc4590ecc07","created_at":"2026-09-04T07:33:12.422Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-39cc6aada8644c4f","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:12.435Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-1c8cc171af2a2bc4590ecc07: start","job_status":"start","queue_duration_s":3.589576,"scheduling_latency_s":3.589604}2542gitlab # [ 534.229773] gitlab-workhorse[816]: time="2026-09-04T07:33:16Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672543gitlab # [ 534.232816] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:33:16 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 982544gitlab # [ 534.234852] gitaly[896]: time="2026-09-04T07:33:16.037Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNC2H4N68B73KC6JDTWF75 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:33:16.019" pid=896 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2545gitlab # [ 534.245752] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:16.090Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"1c8cc171af2a2bc4590ecc07","created_at":"2026-09-04T07:33:12.422Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-39cc6aada8644c4f","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:12.435Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-1c8cc171af2a2bc4590ecc07: done: 0.065424 sec","job_status":"done","queue_duration_s":3.589576,"scheduling_latency_s":3.589604,"redis_calls":13,"redis_duration_s":0.005026,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00202,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001577,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000559,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00087,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043171,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00042826,"duration_s":0.065424,"completed_at":"2026-09-04T07:33:16.090Z","load_balancing_strategy":"primary","db_duration_s":0.008557,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2546gitlab # [ 534.292232] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:16.093Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"fee7e243cd7b9f5a3160ac7f","created_at":"2026-09-04T07:33:12.436Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-39cc6aada8644c4f","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:12.450Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-fee7e243cd7b9f5a3160ac7f: start","job_status":"start","queue_duration_s":3.642992,"scheduling_latency_s":3.64303}2547gitlab # [ 534.308820] gitaly[896]: time="2026-09-04T07:33:16.037Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=7 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNC2H4N68B73KC6JDTWF75 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:33:16.019" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2548gitlab # [ 534.322224] gitaly[896]: time="2026-09-04T07:33:16.038Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=7 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNC2H4N68B73KC6JDTWF75 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:33:16.019" grpc.time_ms=18.854 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2549gitlab # [ 534.336801] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:16.197Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"fee7e243cd7b9f5a3160ac7f","created_at":"2026-09-04T07:33:12.436Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-39cc6aada8644c4f","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:12.450Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-fee7e243cd7b9f5a3160ac7f: done: 0.104812 sec","job_status":"done","queue_duration_s":3.642992,"scheduling_latency_s":3.64303,"redis_calls":10,"redis_duration_s":0.014043,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.005963,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007298,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000782,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0017372,"duration_s":0.104812,"completed_at":"2026-09-04T07:33:16.197Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012446,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2550gitlab # [ 534.381643] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:16.202Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"131f9df4c8978972965449b7","created_at":"2026-09-04T07:33:12.451Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-39cc6aada8644c4f","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:12.465Z","job_size_bytes":19,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-131f9df4c8978972965449b7: start","job_status":"start","queue_duration_s":3.736505,"scheduling_latency_s":3.736548}2551gitlab # [ 534.398635] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:33:16 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1282552gitlab # [ 534.400849] gitaly[896]: time="2026-09-04T07:33:16.220Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NNC2NWSYEYCMWQG70STMBH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:33:16.207" grpc.time_ms=12.445 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2553gitlab # [ 534.414251] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:16.293Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"131f9df4c8978972965449b7","created_at":"2026-09-04T07:33:12.451Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-39cc6aada8644c4f","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:12.465Z","job_size_bytes":19,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-131f9df4c8978972965449b7: done: 0.091347 sec","job_status":"done","queue_duration_s":3.736505,"scheduling_latency_s":3.736548,"redis_calls":11,"redis_duration_s":0.025507000000000002,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001266,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.015559,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.008682,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00051174,"duration_s":0.091347,"completed_at":"2026-09-04T07:33:16.293Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007109,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2554gitlab # [ 534.460927] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:16.296Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"616a02f2d0e258d286558319","created_at":"2026-09-04T07:33:12.472Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-39cc6aada8644c4f","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:12.482Z","job_size_bytes":66,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-616a02f2d0e258d286558319: start","job_status":"start","queue_duration_s":3.814241,"scheduling_latency_s":3.814281}2555gitlab # [ 534.478947] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:16.359Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"616a02f2d0e258d286558319","created_at":"2026-09-04T07:33:12.472Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-39cc6aada8644c4f","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:12.482Z","job_size_bytes":66,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-616a02f2d0e258d286558319: done: 0.062422 sec","job_status":"done","queue_duration_s":3.814241,"scheduling_latency_s":3.814281,"redis_calls":10,"redis_duration_s":0.003151,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000549,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00152,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001082,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006004,"duration_s":0.062422,"completed_at":"2026-09-04T07:33:16.359Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007338,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2556gitlab # [ 534.524714] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:16.361Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"733f9f564173067f9ba03401","created_at":"2026-09-04T07:33:12.485Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-39cc6aada8644c4f","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:12.495Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-733f9f564173067f9ba03401: start","job_status":"start","queue_duration_s":3.866313,"scheduling_latency_s":3.866354}2557gitlab # [ 534.541011] gitlab-workhorse[816]: time="2026-09-04T07:33:16Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672558gitlab # [ 534.542880] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:33:16 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1092559gitlab # [ 534.544920] gitaly[896]: time="2026-09-04T07:33:16.331Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNC2SYNY70H7BAYY3PQE0J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:33:16.313" pid=896 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2560gitlab # [ 534.555298] gitaly[896]: time="2026-09-04T07:33:16.331Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=9 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNC2SYNY70H7BAYY3PQE0J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:33:16.313" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2561gitlab # [ 534.569058] gitaly[896]: time="2026-09-04T07:33:16.331Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=9 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNC2SYNY70H7BAYY3PQE0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:33:16.313" grpc.time_ms=18.485 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2562gitlab # [ 534.583662] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:16.449Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"733f9f564173067f9ba03401","created_at":"2026-09-04T07:33:12.485Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-39cc6aada8644c4f","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:12.495Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-733f9f564173067f9ba03401: done: 0.088316 sec","job_status":"done","queue_duration_s":3.866313,"scheduling_latency_s":3.866354,"redis_calls":10,"redis_duration_s":0.011442,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001753,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005773,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003916,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057008,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00070726,"duration_s":0.088316,"completed_at":"2026-09-04T07:33:16.449Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013842,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2563gitlab # [ 534.631783] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:16.456Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"03320d42d4d2f97c8483a05a","created_at":"2026-09-04T07:33:12.510Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-39cc6aada8644c4f","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:12.519Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-03320d42d4d2f97c8483a05a: start","job_status":"start","queue_duration_s":3.937634,"scheduling_latency_s":3.937675}2564gitlab # [ 534.649342] gitaly[896]: time="2026-09-04T07:33:16.445Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNC2YK7PPSDA6V6C9X37A0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:33:46.142" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:16.442" grpc.time_ms=2.054 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2565gitlab # [ 534.662910] gitaly[896]: time="2026-09-04T07:33:16.476Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=13 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NNC2YK7PPSDA6V6C9X37A0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-04T07:33:46.156" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:16.456" grpc.time_ms=19.169 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2566gitlab # [ 534.678075] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:16.544Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"03320d42d4d2f97c8483a05a","created_at":"2026-09-04T07:33:12.510Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-39cc6aada8644c4f","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:12.519Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-03320d42d4d2f97c8483a05a: done: 0.087476 sec","job_status":"done","queue_duration_s":3.937634,"scheduling_latency_s":3.937675,"redis_calls":10,"redis_duration_s":0.006095,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000838,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004722,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000535,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004121,"duration_s":0.087476,"completed_at":"2026-09-04T07:33:16.544Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025778,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2567gitlab # [ 534.722288] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:16.546Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"90495385c134396576c01d7d","created_at":"2026-09-04T07:33:12.520Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-39cc6aada8644c4f","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:12.527Z","job_size_bytes":6,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-90495385c134396576c01d7d: start","job_status":"start","queue_duration_s":4.01856,"scheduling_latency_s":4.018599}2568gitlab # [ 534.738185] gitaly[896]: time="2026-09-04T07:33:16.496Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNC2YK7PPSDA6V6C9X37A0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:33:26.285" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:16.485" grpc.time_ms=10.473 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2569gitlab # [ 534.751552] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:16.586Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"90495385c134396576c01d7d","created_at":"2026-09-04T07:33:12.520Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-39cc6aada8644c4f","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:12.527Z","job_size_bytes":6,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-90495385c134396576c01d7d: done: 0.040062 sec","job_status":"done","queue_duration_s":4.01856,"scheduling_latency_s":4.018599,"redis_calls":10,"redis_duration_s":0.006254,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001432,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004348,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000474,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020114,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032812,"duration_s":0.040062,"completed_at":"2026-09-04T07:33:16.586Z","load_balancing_strategy":"primary","db_duration_s":0.004867,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2570gitlab # [ 534.795838] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:16.588Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"3428343d27c8d9ac9ceca49f","created_at":"2026-09-04T07:33:12.528Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-39cc6aada8644c4f","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:12.536Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-3428343d27c8d9ac9ceca49f: start","job_status":"start","queue_duration_s":4.05212,"scheduling_latency_s":4.052144}2571gitlab # [ 534.812049] gitaly[896]: time="2026-09-04T07:33:16.551Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNC2YK7PPSDA6V6C9X37A0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T07:33:26.010" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:33:16.550" grpc.time_ms=0.323 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2572gitlab # [ 534.823694] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:16.644Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"3428343d27c8d9ac9ceca49f","created_at":"2026-09-04T07:33:12.528Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-39cc6aada8644c4f","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:12.536Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-3428343d27c8d9ac9ceca49f: done: 0.05656 sec","job_status":"done","queue_duration_s":4.05212,"scheduling_latency_s":4.052144,"redis_calls":10,"redis_duration_s":0.0061849999999999995,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00045,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001338,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004397,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028696,"duration_s":0.05656,"completed_at":"2026-09-04T07:33:16.644Z","load_balancing_strategy":"primary","db_duration_s":0.009366,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2573gitlab # [ 534.869752] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:16.646Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"b094c8391460a2cd4ce3f978","created_at":"2026-09-04T07:33:12.546Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-39cc6aada8644c4f","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:12.554Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-b094c8391460a2cd4ce3f978: start","job_status":"start","queue_duration_s":4.09237,"scheduling_latency_s":4.092396}2574gitlab # [ 534.886135] gitaly[896]: time="2026-09-04T07:33:16.570Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNC2YK7PPSDA6V6C9X37A0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T07:33:26.019" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:16.559" grpc.time_ms=10.329 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2575gitlab # [ 534.899694] gitaly[896]: time="2026-09-04T07:33:16.623Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNC2YK7PPSDA6V6C9X37A0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:33:16.622" grpc.time_ms=0.451 pid=896 span.kind=server system=grpc2576gitlab # [ 534.909685] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:16.757Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"b094c8391460a2cd4ce3f978","created_at":"2026-09-04T07:33:12.546Z","trace_propagation_headers":{"sentry-trace":"9bec7e9de7fc4115bf62b3c53f41f6e1-39cc6aada8644c4f","baggage":"sentry-trace_id=9bec7e9de7fc4115bf62b3c53f41f6e1,sentry-release=Unknown"},"correlation_id":"01M1NN7WEM380H2A4Z9FJ9Y346","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:12.554Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-b094c8391460a2cd4ce3f978: done: 0.110648 sec","job_status":"done","queue_duration_s":4.09237,"scheduling_latency_s":4.092396,"redis_calls":14,"redis_duration_s":0.0072429999999999994,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001974,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001395,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003874,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05844,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028862,"duration_s":0.110648,"completed_at":"2026-09-04T07:33:16.757Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021023,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2577gitlab # [ 534.953472] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:16.759Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"757eed52101d8b656b0ebed1","created_at":"2026-09-04T07:33:12.880Z","trace_propagation_headers":{"sentry-trace":"10749061cc9343b4adef3449910ff808-fb243db7122845e8","baggage":"sentry-trace_id=10749061cc9343b4adef3449910ff808,sentry-release=Unknown"},"correlation_id":"01M1NN7ER63XE7NAN0J0KE5DX0","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:12.888Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-757eed52101d8b656b0ebed1: start","job_status":"start","queue_duration_s":3.870942,"scheduling_latency_s":3.87097}2578gitlab # [ 534.969955] gitaly[896]: time="2026-09-04T07:33:16.658Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNC2YK7PPSDA6V6C9X37A0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:33:16.657" grpc.time_ms=1.277 pid=896 span.kind=server system=grpc2579gitlab # [ 534.979647] gitaly[896]: time="2026-09-04T07:33:16.671Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNC2YK7PPSDA6V6C9X37A0 diskcache=9859271c-2fee-4867-8338-6d7918ea3a9e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:33:26.034" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:33:16.574" pid=896 ref=refs/keep-around/fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 remote_ip="2001:db8:1::1" revision=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 span.kind=server system=grpc username=root2580gitlab # [ 534.991594] nixbot[3856]: {"ts": "2026-09-04T07:33:16.837Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 \"HTTP/1.1 201 Created\""}2581gitlab # [ 534.994677] nixbot[3856]: {"ts": "2026-09-04T07:33:16.847Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-fa1e5af9ac2e-5"}2582gitlab # [ 534.997232] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:16.837Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"757eed52101d8b656b0ebed1","created_at":"2026-09-04T07:33:12.880Z","trace_propagation_headers":{"sentry-trace":"10749061cc9343b4adef3449910ff808-fb243db7122845e8","baggage":"sentry-trace_id=10749061cc9343b4adef3449910ff808,sentry-release=Unknown"},"correlation_id":"01M1NN7ER63XE7NAN0J0KE5DX0","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:12.888Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-757eed52101d8b656b0ebed1: done: 0.078648 sec","job_status":"done","queue_duration_s":3.870942,"scheduling_latency_s":3.87097,"redis_calls":19,"redis_duration_s":0.003819,"redis_read_bytes":21,"redis_write_bytes":4291,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000861,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000572,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2262,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001633,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000753,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.052676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0135407,"duration_s":0.078648,"completed_at":"2026-09-04T07:33:16.837Z","load_balancing_strategy":"primary","db_duration_s":0.018146,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2583gitlab # [ 535.046135] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:16.839Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","696936a8dcdba2e884ba51b5"],"class":"WebHooks::LogExecutionWorker","jid":"a383279e48bfda9fc698c085","created_at":"2026-09-04T07:33:14.551Z","trace_propagation_headers":{"sentry-trace":"10749061cc9343b4adef3449910ff808-b3835867050c4b93","baggage":"sentry-trace_id=10749061cc9343b4adef3449910ff808,sentry-release=Unknown"},"correlation_id":"01M1NN7ER63XE7NAN0J0KE5DX0","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:41bcea08c776531623cc0b84b52e59359592858ef3647dc27df45e009b4633f0","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:14.567Z","job_size_bytes":2592,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-a383279e48bfda9fc698c085: start","job_status":"start","queue_duration_s":2.27255,"scheduling_latency_s":2.272579}2584gitlab # [ 535.063763] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:33:16 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 4642585gitlab # [ 535.066622] gitaly[896]: time="2026-09-04T07:33:16.672Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=58 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4960 command.oublock=8 command.real_time_ms=91 command.spawn_token_fork_ms=4 command.system_time_ms=37 command.user_time_ms=21 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNC2YK7PPSDA6V6C9X37A0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:33:26.034" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:33:16.574" grpc.time_ms=97.449 pid=896 ref=refs/keep-around/fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 remote_ip="2001:db8:1::1" revision=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 span.kind=server system=grpc username=root2586gitlab # [ 535.083187] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:16.913Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","696936a8dcdba2e884ba51b5"],"class":"WebHooks::LogExecutionWorker","jid":"a383279e48bfda9fc698c085","created_at":"2026-09-04T07:33:14.551Z","trace_propagation_headers":{"sentry-trace":"10749061cc9343b4adef3449910ff808-b3835867050c4b93","baggage":"sentry-trace_id=10749061cc9343b4adef3449910ff808,sentry-release=Unknown"},"correlation_id":"01M1NN7ER63XE7NAN0J0KE5DX0","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:41bcea08c776531623cc0b84b52e59359592858ef3647dc27df45e009b4633f0","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:14.567Z","job_size_bytes":2592,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-a383279e48bfda9fc698c085: done: 0.07345 sec","job_status":"done","queue_duration_s":2.27255,"scheduling_latency_s":2.272579,"redis_calls":10,"redis_duration_s":0.003163,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000395,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002141,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000627,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04776,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0008221,"duration_s":0.07345,"completed_at":"2026-09-04T07:33:16.913Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012666,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2587gitlab # [ 535.129855] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:16.915Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"6c55c03202ed1a9f63af8b25","created_at":"2026-09-04T07:33:15.216Z","trace_propagation_headers":{"sentry-trace":"af26cb2c2b6b45ad989dd875e3c04824-9fbe6143ae9a46b4","baggage":"sentry-trace_id=af26cb2c2b6b45ad989dd875e3c04824,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNC1JGWZTZ2JHTFG6WG4Z1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:15.223Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-6c55c03202ed1a9f63af8b25: start","job_status":"start","queue_duration_s":1.692665,"scheduling_latency_s":1.692698}2588gitlab # [ 535.146354] gitaly[896]: time="2026-09-04T07:33:16.677Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNC2YK7PPSDA6V6C9X37A0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:33:46.376" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:16.677" grpc.time_ms=0.319 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2589gitlab # [ 535.159052] nixbot[3856]: {"ts": "2026-09-04T07:33:17.031Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-fa1e5af9ac2e-5", "argv0": "bwrap"}2590gitlab # [ 535.193411] gitaly[896]: time="2026-09-04T07:33:17.079Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNC1JGWZTZ2JHTFG6WG4Z1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:33:17.078" grpc.time_ms=0.583 pid=896 span.kind=server system=grpc2591gitlab # [ 535.235124] gitaly[896]: time="2026-09-04T07:33:17.121Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNC1JGWZTZ2JHTFG6WG4Z1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:33:17.119" grpc.time_ms=1.738 pid=896 span.kind=server system=grpc2592gitlab # [ 535.250934] nix-daemon[4116]: accepted connection from pid 4881, user nixbot2593gitlab # [ 535.279825] gitaly[896]: time="2026-09-04T07:33:17.165Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNC1JGWZTZ2JHTFG6WG4Z1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:33:17.165" grpc.time_ms=0.466 pid=896 span.kind=server system=grpc2594gitlab # [ 535.291266] gitaly[896]: time="2026-09-04T07:33:17.174Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNC1JGWZTZ2JHTFG6WG4Z1 diskcache=c5b833fb-2fe2-4cc8-8caa-f54c09e38fd4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:33:47.050" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:17.050" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2595gitlab # [ 535.301979] gitaly[896]: time="2026-09-04T07:33:17.184Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=100 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7123 command.oublock=0 command.real_time_ms=119 command.spawn_token_fork_ms=0 command.system_time_ms=51 command.user_time_ms=49 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNC1JGWZTZ2JHTFG6WG4Z1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:33:47.050" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:17.050" grpc.time_ms=123.913 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2596gitlab # [ 535.356005] gitaly[896]: time="2026-09-04T07:33:17.241Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNC1JGWZTZ2JHTFG6WG4Z1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:33:47.240" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:17.240" grpc.time_ms=0.975 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2597gitlab # [ 535.394289] gitaly[896]: time="2026-09-04T07:33:17.280Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNC1JGWZTZ2JHTFG6WG4Z1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:33:47.278" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:17.279" grpc.time_ms=0.929 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2598gitlab # [ 535.414559] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:17.294Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"6c55c03202ed1a9f63af8b25","created_at":"2026-09-04T07:33:15.216Z","trace_propagation_headers":{"sentry-trace":"af26cb2c2b6b45ad989dd875e3c04824-9fbe6143ae9a46b4","baggage":"sentry-trace_id=af26cb2c2b6b45ad989dd875e3c04824,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNC1JGWZTZ2JHTFG6WG4Z1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:15.223Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3873,"job_status":"rescheduled","message":"PipelineProcessWorker JID-6c55c03202ed1a9f63af8b25: rescheduled"}2599gitlab # [ 535.435128] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:17.303Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"6c55c03202ed1a9f63af8b25","created_at":"2026-09-04T07:33:15.216Z","trace_propagation_headers":{"sentry-trace":"af26cb2c2b6b45ad989dd875e3c04824-9fbe6143ae9a46b4","baggage":"sentry-trace_id=af26cb2c2b6b45ad989dd875e3c04824,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNC1JGWZTZ2JHTFG6WG4Z1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:15.223Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-6c55c03202ed1a9f63af8b25: done: 0.388092 sec","job_status":"done","queue_duration_s":1.692665,"scheduling_latency_s":1.692698,"gitaly_calls":3,"gitaly_duration_s":0.134092,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.01584,"redis_read_bytes":151,"redis_write_bytes":18015,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000685,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001098,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.002925,"redis_queues_read_bytes":29,"redis_queues_write_bytes":12314,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.007788,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000337,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000457,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001865,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.055,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.011,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.011,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.026,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.195749,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.3203369,"duration_s":0.388092,"completed_at":"2026-09-04T07:33:17.303Z","load_balancing_strategy":"primary","db_duration_s":0.056414,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2600gitlab # [ 535.491422] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:17.305Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","87ca1781c90fc44519fea8ab"],"class":"WebHooks::LogExecutionWorker","jid":"2521b0787cf211ac3fee3ebb","created_at":"2026-09-04T07:33:15.754Z","trace_propagation_headers":{"sentry-trace":"bb83478b1f754f1c8126e8d21b5d52c3-d69c2fbe8e094ff3","baggage":"sentry-trace_id=bb83478b1f754f1c8126e8d21b5d52c3,sentry-release=Unknown"},"correlation_id":"01M1NN7TRR78KHX0BDGKW9AFXT","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0f92c18ebb75a00a39073b54329d5c0651b5109b925a7d785e3e5fa2869adc89","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:15.759Z","job_size_bytes":2591,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-2521b0787cf211ac3fee3ebb: start","job_status":"start","queue_duration_s":1.546607,"scheduling_latency_s":1.546636}2601gitlab # [ 535.510374] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:17.343Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","87ca1781c90fc44519fea8ab"],"class":"WebHooks::LogExecutionWorker","jid":"2521b0787cf211ac3fee3ebb","created_at":"2026-09-04T07:33:15.754Z","trace_propagation_headers":{"sentry-trace":"bb83478b1f754f1c8126e8d21b5d52c3-d69c2fbe8e094ff3","baggage":"sentry-trace_id=bb83478b1f754f1c8126e8d21b5d52c3,sentry-release=Unknown"},"correlation_id":"01M1NN7TRR78KHX0BDGKW9AFXT","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0f92c18ebb75a00a39073b54329d5c0651b5109b925a7d785e3e5fa2869adc89","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:15.759Z","job_size_bytes":2591,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-2521b0787cf211ac3fee3ebb: done: 0.038141 sec","job_status":"done","queue_duration_s":1.546607,"scheduling_latency_s":1.546636,"redis_calls":7,"redis_duration_s":0.002198,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001635,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000563,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026326,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038141,"completed_at":"2026-09-04T07:33:17.343Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00595,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2602gitlab # [ 535.554302] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:17.346Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"c42bb1936b84357c171bb4e4","created_at":"2026-09-04T07:33:16.697Z","trace_propagation_headers":{"sentry-trace":"5f0c6d110fe248cfa5a8676908f67943-0fae91addb454bf6","baggage":"sentry-trace_id=5f0c6d110fe248cfa5a8676908f67943,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNC2YK7PPSDA6V6C9X37A0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:16.704Z","job_size_bytes":65,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-c42bb1936b84357c171bb4e4: start","job_status":"start","queue_duration_s":0.641297,"scheduling_latency_s":0.641334}2603gitlab # [ 535.570893] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:17.396Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"c42bb1936b84357c171bb4e4","created_at":"2026-09-04T07:33:16.697Z","trace_propagation_headers":{"sentry-trace":"5f0c6d110fe248cfa5a8676908f67943-0fae91addb454bf6","baggage":"sentry-trace_id=5f0c6d110fe248cfa5a8676908f67943,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNC2YK7PPSDA6V6C9X37A0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:16.704Z","job_size_bytes":65,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-c42bb1936b84357c171bb4e4: done: 0.05021 sec","job_status":"done","queue_duration_s":0.641297,"scheduling_latency_s":0.641334,"redis_calls":7,"redis_duration_s":0.001905,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001404,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000501,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037032,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.05021,"completed_at":"2026-09-04T07:33:17.396Z","load_balancing_strategy":"primary","db_duration_s":0.006718,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2604gitlab # [ 535.613583] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:17.398Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"c9902fdcb40315a67723b28a","created_at":"2026-09-04T07:33:16.706Z","trace_propagation_headers":{"sentry-trace":"5f0c6d110fe248cfa5a8676908f67943-0fae91addb454bf6","baggage":"sentry-trace_id=5f0c6d110fe248cfa5a8676908f67943,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNC2YK7PPSDA6V6C9X37A0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:16.713Z","job_size_bytes":65,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-c9902fdcb40315a67723b28a: start","job_status":"start","queue_duration_s":0.684843,"scheduling_latency_s":0.684882}2605gitlab # [ 535.631353] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:17.467Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"c9902fdcb40315a67723b28a","created_at":"2026-09-04T07:33:16.706Z","trace_propagation_headers":{"sentry-trace":"5f0c6d110fe248cfa5a8676908f67943-0fae91addb454bf6","baggage":"sentry-trace_id=5f0c6d110fe248cfa5a8676908f67943,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNC2YK7PPSDA6V6C9X37A0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:16.713Z","job_size_bytes":65,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-c9902fdcb40315a67723b28a: done: 0.069683 sec","job_status":"done","queue_duration_s":0.684843,"scheduling_latency_s":0.684882,"redis_calls":10,"redis_duration_s":0.0028510000000000002,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001433,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001418,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.069683,"completed_at":"2026-09-04T07:33:17.467Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015718,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2606gitlab # [ 535.675562] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:17.469Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"42106e6b0c2e3eb644d55ccb","created_at":"2026-09-04T07:33:16.803Z","trace_propagation_headers":{"sentry-trace":"5f0c6d110fe248cfa5a8676908f67943-0fae91addb454bf6","baggage":"sentry-trace_id=5f0c6d110fe248cfa5a8676908f67943,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNC2YK7PPSDA6V6C9X37A0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:16.811Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-42106e6b0c2e3eb644d55ccb: start","job_status":"start","queue_duration_s":0.658604,"scheduling_latency_s":0.658634}2607gitlab # [ 535.692682] gitaly[896]: time="2026-09-04T07:33:17.571Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNC2YK7PPSDA6V6C9X37A0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:33:47.569" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:17.570" grpc.time_ms=0.9 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2608gitlab # [ 535.737652] gitaly[896]: time="2026-09-04T07:33:17.623Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNC2YK7PPSDA6V6C9X37A0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:33:47.622" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:17.622" grpc.time_ms=0.877 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2609gitlab # [ 535.759756] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:17.645Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"42106e6b0c2e3eb644d55ccb","created_at":"2026-09-04T07:33:16.803Z","trace_propagation_headers":{"sentry-trace":"5f0c6d110fe248cfa5a8676908f67943-0fae91addb454bf6","baggage":"sentry-trace_id=5f0c6d110fe248cfa5a8676908f67943,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNC2YK7PPSDA6V6C9X37A0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:16.811Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-42106e6b0c2e3eb644d55ccb: done: 0.175701 sec","job_status":"done","queue_duration_s":0.658604,"scheduling_latency_s":0.658634,"gitaly_calls":2,"gitaly_duration_s":0.01409,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.007787,"redis_read_bytes":80,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001325,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001131,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000422,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001661,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000314,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000598,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001011,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.13011,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.1353818,"duration_s":0.175701,"completed_at":"2026-09-04T07:33:17.645Z","load_balancing_strategy":"primary","db_duration_s":0.035413,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2610gitlab # [ 535.834248] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:17.647Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"b6070605f5a66724dbf63404","created_at":"2026-09-04T07:33:16.815Z","trace_propagation_headers":{"sentry-trace":"10749061cc9343b4adef3449910ff808-e726239f6ed24958","baggage":"sentry-trace_id=10749061cc9343b4adef3449910ff808,sentry-release=Unknown"},"correlation_id":"01M1NN7ER63XE7NAN0J0KE5DX0","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:16.825Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-b6070605f5a66724dbf63404: start","job_status":"start","queue_duration_s":0.821612,"scheduling_latency_s":0.821638}2611gitlab # [ 535.867824] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:17.753Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"b6070605f5a66724dbf63404","created_at":"2026-09-04T07:33:16.815Z","trace_propagation_headers":{"sentry-trace":"10749061cc9343b4adef3449910ff808-e726239f6ed24958","baggage":"sentry-trace_id=10749061cc9343b4adef3449910ff808,sentry-release=Unknown"},"correlation_id":"01M1NN7ER63XE7NAN0J0KE5DX0","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:16.825Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-b6070605f5a66724dbf63404: done: 0.106504 sec","job_status":"done","queue_duration_s":0.821612,"scheduling_latency_s":0.821638,"redis_calls":11,"redis_duration_s":0.0029980000000000002,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000362,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002122,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000514,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.01,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.075309,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00051456,"duration_s":0.106504,"completed_at":"2026-09-04T07:33:17.753Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0274,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2612gitlab # [ 535.921844] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:17.755Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"289af0c76c9a45024dcaf195","created_at":"2026-09-04T07:33:17.036Z","trace_propagation_headers":{"sentry-trace":"af26cb2c2b6b45ad989dd875e3c04824-76d21baf6f914499","baggage":"sentry-trace_id=af26cb2c2b6b45ad989dd875e3c04824,sentry-release=Unknown"},"correlation_id":"01M1NNC1JGWZTZ2JHTFG6WG4Z1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:17.040Z","job_size_bytes":23,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-289af0c76c9a45024dcaf195: start","job_status":"start","queue_duration_s":0.714664,"scheduling_latency_s":0.714692}2613gitlab # [ 535.940917] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:17.813Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"289af0c76c9a45024dcaf195","created_at":"2026-09-04T07:33:17.036Z","trace_propagation_headers":{"sentry-trace":"af26cb2c2b6b45ad989dd875e3c04824-76d21baf6f914499","baggage":"sentry-trace_id=af26cb2c2b6b45ad989dd875e3c04824,sentry-release=Unknown"},"correlation_id":"01M1NNC1JGWZTZ2JHTFG6WG4Z1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:17.040Z","job_size_bytes":23,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-289af0c76c9a45024dcaf195: done: 0.05812 sec","job_status":"done","queue_duration_s":0.714664,"scheduling_latency_s":0.714692,"redis_calls":7,"redis_duration_s":0.002882,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001797,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001085,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039016,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.05812,"completed_at":"2026-09-04T07:33:17.813Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014497,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2614gitlab # [ 535.984660] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:17.816Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"d91492fd213be49d4be7bec1","created_at":"2026-09-04T07:33:17.181Z","trace_propagation_headers":{"sentry-trace":"af26cb2c2b6b45ad989dd875e3c04824-76d21baf6f914499","baggage":"sentry-trace_id=af26cb2c2b6b45ad989dd875e3c04824,sentry-release=Unknown"},"correlation_id":"01M1NNC1JGWZTZ2JHTFG6WG4Z1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:17.186Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-d91492fd213be49d4be7bec1: start","job_status":"start","queue_duration_s":0.629464,"scheduling_latency_s":0.629496}2615gitlab # [ 536.001478] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:17.855Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"d91492fd213be49d4be7bec1","created_at":"2026-09-04T07:33:17.181Z","trace_propagation_headers":{"sentry-trace":"af26cb2c2b6b45ad989dd875e3c04824-76d21baf6f914499","baggage":"sentry-trace_id=af26cb2c2b6b45ad989dd875e3c04824,sentry-release=Unknown"},"correlation_id":"01M1NNC1JGWZTZ2JHTFG6WG4Z1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:17.186Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-d91492fd213be49d4be7bec1: done: 0.038926 sec","job_status":"done","queue_duration_s":0.629464,"scheduling_latency_s":0.629496,"redis_calls":7,"redis_duration_s":0.002312,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001601,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000711,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038926,"completed_at":"2026-09-04T07:33:17.854Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008609,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2616gitlab # [ 536.044787] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:17.856Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"db5e9cbd2f34398a75966e72","created_at":"2026-09-04T07:33:17.197Z","trace_propagation_headers":{"sentry-trace":"af26cb2c2b6b45ad989dd875e3c04824-76d21baf6f914499","baggage":"sentry-trace_id=af26cb2c2b6b45ad989dd875e3c04824,sentry-release=Unknown"},"correlation_id":"01M1NNC1JGWZTZ2JHTFG6WG4Z1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:17.202Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-db5e9cbd2f34398a75966e72: start","job_status":"start","queue_duration_s":0.654799,"scheduling_latency_s":0.654826}2617gitlab # [ 536.060877] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:17.894Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"db5e9cbd2f34398a75966e72","created_at":"2026-09-04T07:33:17.197Z","trace_propagation_headers":{"sentry-trace":"af26cb2c2b6b45ad989dd875e3c04824-76d21baf6f914499","baggage":"sentry-trace_id=af26cb2c2b6b45ad989dd875e3c04824,sentry-release=Unknown"},"correlation_id":"01M1NNC1JGWZTZ2JHTFG6WG4Z1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:17.202Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-db5e9cbd2f34398a75966e72: done: 0.037656 sec","job_status":"done","queue_duration_s":0.654799,"scheduling_latency_s":0.654826,"redis_calls":7,"redis_duration_s":0.002474,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001451,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037656,"completed_at":"2026-09-04T07:33:17.894Z","load_balancing_strategy":"primary","db_duration_s":0.009023,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2618gitlab # [ 536.104606] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:17.896Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"3b9476e0219ddf480f04a4d8","created_at":"2026-09-04T07:33:17.212Z","trace_propagation_headers":{"sentry-trace":"af26cb2c2b6b45ad989dd875e3c04824-76d21baf6f914499","baggage":"sentry-trace_id=af26cb2c2b6b45ad989dd875e3c04824,sentry-release=Unknown"},"correlation_id":"01M1NNC1JGWZTZ2JHTFG6WG4Z1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:17.214Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-3b9476e0219ddf480f04a4d8: start","job_status":"start","queue_duration_s":0.681413,"scheduling_latency_s":0.681437}2619gitlab # [ 536.120262] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:17.935Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"3b9476e0219ddf480f04a4d8","created_at":"2026-09-04T07:33:17.212Z","trace_propagation_headers":{"sentry-trace":"af26cb2c2b6b45ad989dd875e3c04824-76d21baf6f914499","baggage":"sentry-trace_id=af26cb2c2b6b45ad989dd875e3c04824,sentry-release=Unknown"},"correlation_id":"01M1NNC1JGWZTZ2JHTFG6WG4Z1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:17.214Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-3b9476e0219ddf480f04a4d8: done: 0.039021 sec","job_status":"done","queue_duration_s":0.681413,"scheduling_latency_s":0.681437,"redis_calls":10,"redis_duration_s":0.002829,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001433,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000842,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000554,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039021,"completed_at":"2026-09-04T07:33:17.935Z","load_balancing_strategy":"primary","db_duration_s":0.008533,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2620gitlab # [ 536.165383] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:17.936Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"1096269e144e45bf471fd747","created_at":"2026-09-04T07:33:17.215Z","trace_propagation_headers":{"sentry-trace":"af26cb2c2b6b45ad989dd875e3c04824-76d21baf6f914499","baggage":"sentry-trace_id=af26cb2c2b6b45ad989dd875e3c04824,sentry-release=Unknown"},"correlation_id":"01M1NNC1JGWZTZ2JHTFG6WG4Z1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:17.217Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-1096269e144e45bf471fd747: start","job_status":"start","queue_duration_s":0.719802,"scheduling_latency_s":0.719825}2621gitlab # [ 536.183441] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:17.971Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"1096269e144e45bf471fd747","created_at":"2026-09-04T07:33:17.215Z","trace_propagation_headers":{"sentry-trace":"af26cb2c2b6b45ad989dd875e3c04824-76d21baf6f914499","baggage":"sentry-trace_id=af26cb2c2b6b45ad989dd875e3c04824,sentry-release=Unknown"},"correlation_id":"01M1NNC1JGWZTZ2JHTFG6WG4Z1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:17.217Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-1096269e144e45bf471fd747: done: 0.035022 sec","job_status":"done","queue_duration_s":0.719802,"scheduling_latency_s":0.719825,"redis_calls":7,"redis_duration_s":0.002214,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001614,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0006,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021967,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035022,"completed_at":"2026-09-04T07:33:17.971Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008085,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2622gitlab # [ 536.230813] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:17.973Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"32744c7aa5732a4d8c421710","created_at":"2026-09-04T07:33:17.217Z","trace_propagation_headers":{"sentry-trace":"af26cb2c2b6b45ad989dd875e3c04824-76d21baf6f914499","baggage":"sentry-trace_id=af26cb2c2b6b45ad989dd875e3c04824,sentry-release=Unknown"},"correlation_id":"01M1NNC1JGWZTZ2JHTFG6WG4Z1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:17.219Z","job_size_bytes":19,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-32744c7aa5732a4d8c421710: start","job_status":"start","queue_duration_s":0.753777,"scheduling_latency_s":0.753804}2623gitlab # [ 536.247833] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:18.005Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"32744c7aa5732a4d8c421710","created_at":"2026-09-04T07:33:17.217Z","trace_propagation_headers":{"sentry-trace":"af26cb2c2b6b45ad989dd875e3c04824-76d21baf6f914499","baggage":"sentry-trace_id=af26cb2c2b6b45ad989dd875e3c04824,sentry-release=Unknown"},"correlation_id":"01M1NNC1JGWZTZ2JHTFG6WG4Z1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:17.219Z","job_size_bytes":19,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-32744c7aa5732a4d8c421710: done: 0.032333 sec","job_status":"done","queue_duration_s":0.753777,"scheduling_latency_s":0.753804,"redis_calls":8,"redis_duration_s":0.002369,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001862,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000507,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019152,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032333,"completed_at":"2026-09-04T07:33:18.005Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007318,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2624gitlab # [ 536.290702] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:18.007Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"5b4c4fce793bdd79c7a09472","created_at":"2026-09-04T07:33:17.220Z","trace_propagation_headers":{"sentry-trace":"af26cb2c2b6b45ad989dd875e3c04824-76d21baf6f914499","baggage":"sentry-trace_id=af26cb2c2b6b45ad989dd875e3c04824,sentry-release=Unknown"},"correlation_id":"01M1NNC1JGWZTZ2JHTFG6WG4Z1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:17.222Z","job_size_bytes":66,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-5b4c4fce793bdd79c7a09472: start","job_status":"start","queue_duration_s":0.785197,"scheduling_latency_s":0.785219}2625gitlab # [ 536.309261] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:18.037Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"5b4c4fce793bdd79c7a09472","created_at":"2026-09-04T07:33:17.220Z","trace_propagation_headers":{"sentry-trace":"af26cb2c2b6b45ad989dd875e3c04824-76d21baf6f914499","baggage":"sentry-trace_id=af26cb2c2b6b45ad989dd875e3c04824,sentry-release=Unknown"},"correlation_id":"01M1NNC1JGWZTZ2JHTFG6WG4Z1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:17.222Z","job_size_bytes":66,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-5b4c4fce793bdd79c7a09472: done: 0.029948 sec","job_status":"done","queue_duration_s":0.785197,"scheduling_latency_s":0.785219,"redis_calls":7,"redis_duration_s":0.002129,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001522,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000607,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019074,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029948,"completed_at":"2026-09-04T07:33:18.037Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005521,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2626gitlab # [ 536.353130] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:18.039Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"7e6345486614f6e0f676c941","created_at":"2026-09-04T07:33:17.223Z","trace_propagation_headers":{"sentry-trace":"af26cb2c2b6b45ad989dd875e3c04824-76d21baf6f914499","baggage":"sentry-trace_id=af26cb2c2b6b45ad989dd875e3c04824,sentry-release=Unknown"},"correlation_id":"01M1NNC1JGWZTZ2JHTFG6WG4Z1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:17.224Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-7e6345486614f6e0f676c941: start","job_status":"start","queue_duration_s":0.814875,"scheduling_latency_s":0.814898}2627gitlab # [ 536.371236] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:18.072Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"7e6345486614f6e0f676c941","created_at":"2026-09-04T07:33:17.223Z","trace_propagation_headers":{"sentry-trace":"af26cb2c2b6b45ad989dd875e3c04824-76d21baf6f914499","baggage":"sentry-trace_id=af26cb2c2b6b45ad989dd875e3c04824,sentry-release=Unknown"},"correlation_id":"01M1NNC1JGWZTZ2JHTFG6WG4Z1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:17.224Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-7e6345486614f6e0f676c941: done: 0.032706 sec","job_status":"done","queue_duration_s":0.814875,"scheduling_latency_s":0.814898,"redis_calls":7,"redis_duration_s":0.0020350000000000004,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001463,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000572,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032706,"completed_at":"2026-09-04T07:33:18.072Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008347,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2628gitlab # [ 536.417806] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:18.074Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"711343d9554b1f3f71363c83","created_at":"2026-09-04T07:33:17.225Z","trace_propagation_headers":{"sentry-trace":"af26cb2c2b6b45ad989dd875e3c04824-76d21baf6f914499","baggage":"sentry-trace_id=af26cb2c2b6b45ad989dd875e3c04824,sentry-release=Unknown"},"correlation_id":"01M1NNC1JGWZTZ2JHTFG6WG4Z1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:17.226Z","job_size_bytes":6,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-711343d9554b1f3f71363c83: start","job_status":"start","queue_duration_s":0.847251,"scheduling_latency_s":0.847274}2629gitlab # [ 536.434029] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:18.091Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"711343d9554b1f3f71363c83","created_at":"2026-09-04T07:33:17.225Z","trace_propagation_headers":{"sentry-trace":"af26cb2c2b6b45ad989dd875e3c04824-76d21baf6f914499","baggage":"sentry-trace_id=af26cb2c2b6b45ad989dd875e3c04824,sentry-release=Unknown"},"correlation_id":"01M1NNC1JGWZTZ2JHTFG6WG4Z1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:17.226Z","job_size_bytes":6,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-711343d9554b1f3f71363c83: done: 0.017274 sec","job_status":"done","queue_duration_s":0.847251,"scheduling_latency_s":0.847274,"redis_calls":7,"redis_duration_s":0.0020429999999999997,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001522,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000521,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017274,"completed_at":"2026-09-04T07:33:18.091Z","load_balancing_strategy":"primary","db_duration_s":0.000783,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2630gitlab # [ 536.479071] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:18.093Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"dc51d82ba432f156d179847a","created_at":"2026-09-04T07:33:17.227Z","trace_propagation_headers":{"sentry-trace":"af26cb2c2b6b45ad989dd875e3c04824-76d21baf6f914499","baggage":"sentry-trace_id=af26cb2c2b6b45ad989dd875e3c04824,sentry-release=Unknown"},"correlation_id":"01M1NNC1JGWZTZ2JHTFG6WG4Z1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:17.228Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-dc51d82ba432f156d179847a: start","job_status":"start","queue_duration_s":0.864248,"scheduling_latency_s":0.864268}2631gitlab # [ 536.496924] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:18.126Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"dc51d82ba432f156d179847a","created_at":"2026-09-04T07:33:17.227Z","trace_propagation_headers":{"sentry-trace":"af26cb2c2b6b45ad989dd875e3c04824-76d21baf6f914499","baggage":"sentry-trace_id=af26cb2c2b6b45ad989dd875e3c04824,sentry-release=Unknown"},"correlation_id":"01M1NNC1JGWZTZ2JHTFG6WG4Z1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:17.228Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-dc51d82ba432f156d179847a: done: 0.033653 sec","job_status":"done","queue_duration_s":0.864248,"scheduling_latency_s":0.864268,"redis_calls":7,"redis_duration_s":0.004258,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001688,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00257,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033653,"completed_at":"2026-09-04T07:33:18.126Z","load_balancing_strategy":"primary","db_duration_s":0.006598,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2632gitlab # [ 536.542225] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:18.128Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"9aff69784e68a58946247157","created_at":"2026-09-04T07:33:17.294Z","trace_propagation_headers":{"sentry-trace":"af26cb2c2b6b45ad989dd875e3c04824-76d21baf6f914499","baggage":"sentry-trace_id=af26cb2c2b6b45ad989dd875e3c04824,sentry-release=Unknown"},"correlation_id":"01M1NNC1JGWZTZ2JHTFG6WG4Z1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:17.297Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9aff69784e68a58946247157: start","job_status":"start","queue_duration_s":0.831539,"scheduling_latency_s":0.831561}2633gitlab # [ 536.558705] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:18.163Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"9aff69784e68a58946247157","created_at":"2026-09-04T07:33:17.294Z","trace_propagation_headers":{"sentry-trace":"af26cb2c2b6b45ad989dd875e3c04824-76d21baf6f914499","baggage":"sentry-trace_id=af26cb2c2b6b45ad989dd875e3c04824,sentry-release=Unknown"},"correlation_id":"01M1NNC1JGWZTZ2JHTFG6WG4Z1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:17.297Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9aff69784e68a58946247157: done: 0.035125 sec","job_status":"done","queue_duration_s":0.831539,"scheduling_latency_s":0.831561,"redis_calls":8,"redis_duration_s":0.002584,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002013,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000571,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022119,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035125,"completed_at":"2026-09-04T07:33:18.163Z","load_balancing_strategy":"primary","db_duration_s":0.007438,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2634gitlab # [ 536.601003] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:18.165Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"ace7eb4724af4cb172d09777","created_at":"2026-09-04T07:33:17.547Z","trace_propagation_headers":{"sentry-trace":"5f0c6d110fe248cfa5a8676908f67943-7c350fb74ccd47b0","baggage":"sentry-trace_id=5f0c6d110fe248cfa5a8676908f67943,sentry-release=Unknown"},"correlation_id":"01M1NNC2YK7PPSDA6V6C9X37A0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:17.551Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-ace7eb4724af4cb172d09777: start","job_status":"start","queue_duration_s":0.614666,"scheduling_latency_s":0.61469}2635gitlab # [ 536.617416] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:18.211Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"ace7eb4724af4cb172d09777","created_at":"2026-09-04T07:33:17.547Z","trace_propagation_headers":{"sentry-trace":"5f0c6d110fe248cfa5a8676908f67943-7c350fb74ccd47b0","baggage":"sentry-trace_id=5f0c6d110fe248cfa5a8676908f67943,sentry-release=Unknown"},"correlation_id":"01M1NNC2YK7PPSDA6V6C9X37A0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:17.551Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-ace7eb4724af4cb172d09777: done: 0.04595 sec","job_status":"done","queue_duration_s":0.614666,"scheduling_latency_s":0.61469,"redis_calls":7,"redis_duration_s":0.002434,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001751,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000683,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031505,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.04595,"completed_at":"2026-09-04T07:33:18.211Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009247,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2636gitlab # [ 539.607160] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:21.491Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"761c3368f3dbbe23f8cbb0f2","created_at":"2026-09-04T07:33:21.462Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:21.487Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-761c3368f3dbbe23f8cbb0f2: start","job_status":"start","queue_duration_s":0.003616,"scheduling_latency_s":0.003676}2637gitlab # [ 539.819546] nix-daemon[4116]: accepted connection from pid 4922, user nixbot2638gitlab # [ 539.851159] nix-daemon[4116]: accepted connection from pid 4881, user nixbot2639gitlab # [ 540.305344] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:22.189Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"761c3368f3dbbe23f8cbb0f2","created_at":"2026-09-04T07:33:21.462Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:21.487Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-761c3368f3dbbe23f8cbb0f2: done: 0.698345 sec","job_status":"done","queue_duration_s":0.003616,"scheduling_latency_s":0.003676,"redis_calls":70,"redis_duration_s":0.21528599999999998,"redis_read_bytes":118,"redis_write_bytes":42580,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.017419,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.005241,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.189822,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.002804,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.310866,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.698345,"completed_at":"2026-09-04T07:33:22.189Z","load_balancing_strategy":"primary","db_duration_s":0.01799,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2640gitlab # [ 540.410452] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:22.203Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"a0bc43982d8773d44a2c741e","created_at":"2026-09-04T07:33:21.510Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca191698d7c63f7cabd17f71407e6177","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:33:21.550Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-a0bc43982d8773d44a2c741e: start","job_status":"start","queue_duration_s":0.653305,"scheduling_latency_s":0.65337}2641gitlab # [ 540.618313] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:22.502Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}2642gitlab # [ 540.676464] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:22.559Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"a0bc43982d8773d44a2c741e","created_at":"2026-09-04T07:33:21.510Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca191698d7c63f7cabd17f71407e6177","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:33:21.550Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-a0bc43982d8773d44a2c741e: done: 0.355392 sec","job_status":"done","queue_duration_s":0.653305,"scheduling_latency_s":0.65337,"redis_calls":9,"redis_duration_s":0.232687,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003379,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.225747,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003561,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.355392,"completed_at":"2026-09-04T07:33:22.558Z","load_balancing_strategy":"primary","db_duration_s":0.004674,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2643gitlab # [ 540.760315] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:22.574Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"f343975d350d17f93f263a2e","created_at":"2026-09-04T07:33:21.575Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8c31e73729e90e4d859ba1d23b940908","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:21.682Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-f343975d350d17f93f263a2e: start","job_status":"start","queue_duration_s":0.892363,"scheduling_latency_s":0.892428}2644gitlab # [ 540.855739] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:22.740Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"f343975d350d17f93f263a2e","created_at":"2026-09-04T07:33:21.575Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8c31e73729e90e4d859ba1d23b940908","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:21.682Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-f343975d350d17f93f263a2e: done: 0.165931 sec","job_status":"done","queue_duration_s":0.892363,"scheduling_latency_s":0.892428,"redis_calls":12,"redis_duration_s":0.031575,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.006063,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.017757,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.007755,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.068507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.02762614,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.165931,"completed_at":"2026-09-04T07:33:22.740Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016228,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2645gitlab # [ 540.933989] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:22.776Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"da6de103d0c65dfc39f2da41","created_at":"2026-09-04T07:33:21.700Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"81f2f0c97cadc0a4ea2f4d8b7650dc68","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:21.722Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-da6de103d0c65dfc39f2da41: start","job_status":"start","queue_duration_s":1.054327,"scheduling_latency_s":1.054396}2646gitlab # [ 541.312048] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:23.195Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"da6de103d0c65dfc39f2da41","created_at":"2026-09-04T07:33:21.700Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"81f2f0c97cadc0a4ea2f4d8b7650dc68","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:21.722Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-da6de103d0c65dfc39f2da41: done: 0.419087 sec","job_status":"done","queue_duration_s":1.054327,"scheduling_latency_s":1.054396,"redis_calls":13,"redis_duration_s":0.077688,"redis_read_bytes":11,"redis_write_bytes":1780,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.014979,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.012241,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.050468,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.037,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.178275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00358308,"exclusive_lock_hold_duration_s":0.19647606,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.419087,"completed_at":"2026-09-04T07:33:23.195Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.088667,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2647gitlab # [ 541.409647] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:23.266Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"6d3e45a6c29f6f96df38efdc","created_at":"2026-09-04T07:33:21.740Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"896ff062ba2aaa783d5bfec92d7b5b25","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:21.768Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-6d3e45a6c29f6f96df38efdc: start","job_status":"start","queue_duration_s":1.498189,"scheduling_latency_s":1.498261}2648gitlab # [ 541.487302] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:23.372Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"6d3e45a6c29f6f96df38efdc","created_at":"2026-09-04T07:33:21.740Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"896ff062ba2aaa783d5bfec92d7b5b25","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:21.768Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-6d3e45a6c29f6f96df38efdc: done: 0.105977 sec","job_status":"done","queue_duration_s":1.498189,"scheduling_latency_s":1.498261,"redis_calls":9,"redis_duration_s":0.006724,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001706,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003719,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001299,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.067218,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.105977,"completed_at":"2026-09-04T07:33:23.372Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00815,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2649gitlab # [ 541.572389] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:23.376Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"c5a060f2f91d5104f5e790ca","created_at":"2026-09-04T07:33:21.783Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cac26866cee4e0f3c184a4ad876c0ca8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:21.802Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-c5a060f2f91d5104f5e790ca: start","job_status":"start","queue_duration_s":1.573942,"scheduling_latency_s":1.573986}2650gitlab # [ 541.590573] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:23.435Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"c5a060f2f91d5104f5e790ca","created_at":"2026-09-04T07:33:21.783Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cac26866cee4e0f3c184a4ad876c0ca8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:21.802Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-c5a060f2f91d5104f5e790ca: done: 0.059497 sec","job_status":"done","queue_duration_s":1.573942,"scheduling_latency_s":1.573986,"redis_calls":11,"redis_duration_s":0.005306,"redis_read_bytes":9,"redis_write_bytes":1459,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001993,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002484,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000829,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037823,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.059497,"completed_at":"2026-09-04T07:33:23.435Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002624,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2651gitlab # [ 541.637138] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:23.438Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"081ba4f39125d0554597abce","created_at":"2026-09-04T07:33:21.825Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"79690c6110a543242af728e4463f7353","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:21.845Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-081ba4f39125d0554597abce: start","job_status":"start","queue_duration_s":1.593116,"scheduling_latency_s":1.59316}2652gitlab # [ 541.651646] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:23.495Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"081ba4f39125d0554597abce","created_at":"2026-09-04T07:33:21.825Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"79690c6110a543242af728e4463f7353","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:21.845Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-081ba4f39125d0554597abce: done: 0.056881 sec","job_status":"done","queue_duration_s":1.593116,"scheduling_latency_s":1.59316,"redis_calls":9,"redis_duration_s":0.003884,"redis_read_bytes":7,"redis_write_bytes":1026,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000804,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002195,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000885,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032295,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.056881,"completed_at":"2026-09-04T07:33:23.495Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009685,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2653gitlab # [ 541.693063] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:23.500Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"6ed5b900f4d552378a3e2237","created_at":"2026-09-04T07:33:21.864Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a08df51264a325e248e9a71f5cd92878","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:21.893Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-6ed5b900f4d552378a3e2237: start","job_status":"start","queue_duration_s":1.607123,"scheduling_latency_s":1.6072}2654gitlab # [ 541.707141] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:23.527Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}2655gitlab # [ 541.710760] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:23.541Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"6ed5b900f4d552378a3e2237","created_at":"2026-09-04T07:33:21.864Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a08df51264a325e248e9a71f5cd92878","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:21.893Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-6ed5b900f4d552378a3e2237: done: 0.040972 sec","job_status":"done","queue_duration_s":1.607123,"scheduling_latency_s":1.6072,"redis_calls":9,"redis_duration_s":0.002708,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000573,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00157,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000565,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021646,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040972,"completed_at":"2026-09-04T07:33:23.541Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003487,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2656gitlab # [ 541.752211] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:23.546Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c8cebe0681848facec868c95","created_at":"2026-09-04T07:33:21.935Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a32bcee905c76ea84d0c6a54a18b6b67","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:21.959Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c8cebe0681848facec868c95: start","job_status":"start","queue_duration_s":1.587219,"scheduling_latency_s":1.587271}2657gitlab # [ 541.766695] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:23.618Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c8cebe0681848facec868c95","created_at":"2026-09-04T07:33:21.935Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a32bcee905c76ea84d0c6a54a18b6b67","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:21.959Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c8cebe0681848facec868c95: done: 0.07221 sec","job_status":"done","queue_duration_s":1.587219,"scheduling_latency_s":1.587271,"redis_calls":9,"redis_duration_s":0.00314,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000719,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001611,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00081,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.07221,"completed_at":"2026-09-04T07:33:23.618Z","load_balancing_strategy":"primary","db_duration_s":0.027721,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2658gitlab # [ 541.811489] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:23.621Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"32af691844bfe2425ef287ec","created_at":"2026-09-04T07:33:21.980Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e192ab5b09dfe1e657cbd8cd730edf04","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.008Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-32af691844bfe2425ef287ec: start","job_status":"start","queue_duration_s":1.612986,"scheduling_latency_s":1.613026}2659gitlab # [ 542.253220] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.138Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"32af691844bfe2425ef287ec","created_at":"2026-09-04T07:33:21.980Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e192ab5b09dfe1e657cbd8cd730edf04","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.008Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-32af691844bfe2425ef287ec: done: 0.517257 sec","job_status":"done","queue_duration_s":1.612986,"scheduling_latency_s":1.613026,"redis_calls":11,"redis_duration_s":0.004089000000000001,"redis_read_bytes":9,"redis_write_bytes":1292,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000631,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001742,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001716,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.072,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.07,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.42077,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0008374,"exclusive_lock_hold_duration_s":0.4781369,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.517257,"completed_at":"2026-09-04T07:33:24.138Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.116391,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2660gitlab # [ 542.358875] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.141Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"f6d316d840adfefd583af69c","created_at":"2026-09-04T07:33:22.041Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"04945d220d185e96bb6d15a6b2958f93","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.073Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-f6d316d840adfefd583af69c: start","job_status":"start","queue_duration_s":2.068056,"scheduling_latency_s":2.068088}2661gitlab # [ 542.379440] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.196Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"f6d316d840adfefd583af69c","created_at":"2026-09-04T07:33:22.041Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"04945d220d185e96bb6d15a6b2958f93","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.073Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-f6d316d840adfefd583af69c: done: 0.055696 sec","job_status":"done","queue_duration_s":2.068056,"scheduling_latency_s":2.068088,"redis_calls":12,"redis_duration_s":0.00519,"redis_read_bytes":11,"redis_write_bytes":1281,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001376,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002015,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":518,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001799,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":476,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00102456,"exclusive_lock_hold_duration_s":0.01751788,"duration_s":0.055696,"completed_at":"2026-09-04T07:33:24.196Z","load_balancing_strategy":"primary","db_duration_s":0.008573,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2662gitlab # [ 542.426673] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.200Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47a83284ce91d28e62a4ba2d","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47a83284ce91d28e62a4ba2d: start","job_status":"start","queue_duration_s":2.061955,"scheduling_latency_s":2.061992}2663gitlab # [ 542.439240] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47a83284ce91d28e62a4ba2d","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47a83284ce91d28e62a4ba2d: done: 0.042785 sec","job_status":"done","queue_duration_s":2.061955,"scheduling_latency_s":2.061992,"redis_calls":15,"redis_duration_s":0.005461,"redis_read_bytes":12,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000758,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001325,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003378,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.042785,"completed_at":"2026-09-04T07:33:24.242Z","load_balancing_strategy":"primary","db_duration_s":0.001195,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2664gitlab # [ 542.483968] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.245Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0af90a2790e640f63555bce2","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0af90a2790e640f63555bce2: start","job_status":"start","queue_duration_s":2.107033,"scheduling_latency_s":2.107062}2665gitlab # [ 542.497670] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.269Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0af90a2790e640f63555bce2","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0af90a2790e640f63555bce2: done: 0.024859 sec","job_status":"done","queue_duration_s":2.107033,"scheduling_latency_s":2.107062,"redis_calls":13,"redis_duration_s":0.004387,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001833,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002554,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024859,"completed_at":"2026-09-04T07:33:24.269Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2666gitlab # [ 542.537054] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb496b63ad6368d9bacffbf4","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb496b63ad6368d9bacffbf4: start","job_status":"start","queue_duration_s":2.135711,"scheduling_latency_s":2.135742}2667gitlab # [ 542.549405] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb496b63ad6368d9bacffbf4","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb496b63ad6368d9bacffbf4: done: 0.025757 sec","job_status":"done","queue_duration_s":2.135711,"scheduling_latency_s":2.135742,"redis_calls":13,"redis_duration_s":0.003564,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001239,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002325,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016404,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025757,"completed_at":"2026-09-04T07:33:24.299Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2668gitlab # [ 542.588479] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.301Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46d038725b0b9ef2512b4fa1","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46d038725b0b9ef2512b4fa1: start","job_status":"start","queue_duration_s":2.163707,"scheduling_latency_s":2.163739}2669gitlab # [ 542.600781] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.329Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46d038725b0b9ef2512b4fa1","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46d038725b0b9ef2512b4fa1: done: 0.028228 sec","job_status":"done","queue_duration_s":2.163707,"scheduling_latency_s":2.163739,"redis_calls":13,"redis_duration_s":0.004854,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001201,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003653,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028228,"completed_at":"2026-09-04T07:33:24.329Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2670gitlab # [ 542.640491] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.332Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79c3b69ceafec4a142207278","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79c3b69ceafec4a142207278: start","job_status":"start","queue_duration_s":2.194246,"scheduling_latency_s":2.194276}2671gitlab # [ 542.654802] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.357Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79c3b69ceafec4a142207278","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79c3b69ceafec4a142207278: done: 0.025363 sec","job_status":"done","queue_duration_s":2.194246,"scheduling_latency_s":2.194276,"redis_calls":13,"redis_duration_s":0.004015,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001256,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002759,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025363,"completed_at":"2026-09-04T07:33:24.357Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2672gitlab # [ 542.694295] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.360Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e0df915f078bbdee056c4b7","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e0df915f078bbdee056c4b7: start","job_status":"start","queue_duration_s":2.222783,"scheduling_latency_s":2.222814}2673gitlab # [ 542.706692] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.386Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e0df915f078bbdee056c4b7","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e0df915f078bbdee056c4b7: done: 0.026215 sec","job_status":"done","queue_duration_s":2.222783,"scheduling_latency_s":2.222814,"redis_calls":13,"redis_duration_s":0.004162,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001411,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002751,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017237,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026215,"completed_at":"2026-09-04T07:33:24.386Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2674gitlab # [ 542.745860] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.389Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c12c549a4ceef296d95d7afb","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c12c549a4ceef296d95d7afb: start","job_status":"start","queue_duration_s":2.251251,"scheduling_latency_s":2.251284}2675gitlab # [ 542.758375] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.414Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c12c549a4ceef296d95d7afb","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c12c549a4ceef296d95d7afb: done: 0.024868 sec","job_status":"done","queue_duration_s":2.251251,"scheduling_latency_s":2.251284,"redis_calls":13,"redis_duration_s":0.0037010000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001259,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002442,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015409,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024868,"completed_at":"2026-09-04T07:33:24.413Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2676gitlab # [ 542.797640] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3f0265f5157a2a02ad569d4","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3f0265f5157a2a02ad569d4: start","job_status":"start","queue_duration_s":2.278274,"scheduling_latency_s":2.278302}2677gitlab # [ 542.810119] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.442Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3f0265f5157a2a02ad569d4","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3f0265f5157a2a02ad569d4: done: 0.025831 sec","job_status":"done","queue_duration_s":2.278274,"scheduling_latency_s":2.278302,"redis_calls":13,"redis_duration_s":0.0046960000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003197,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016508,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025831,"completed_at":"2026-09-04T07:33:24.441Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2678gitlab # [ 542.850785] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.444Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5176fd340db3f27ec7cc2c1c","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5176fd340db3f27ec7cc2c1c: start","job_status":"start","queue_duration_s":2.306548,"scheduling_latency_s":2.306579}2679gitlab # [ 542.863765] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.468Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5176fd340db3f27ec7cc2c1c","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5176fd340db3f27ec7cc2c1c: done: 0.024149 sec","job_status":"done","queue_duration_s":2.306548,"scheduling_latency_s":2.306579,"redis_calls":13,"redis_duration_s":0.003665,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001339,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002326,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015468,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024149,"completed_at":"2026-09-04T07:33:24.468Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2680gitlab # [ 542.906918] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.470Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4784bf4090ab503db4467c35","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4784bf4090ab503db4467c35: start","job_status":"start","queue_duration_s":2.33257,"scheduling_latency_s":2.332594}2681gitlab # [ 542.921010] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.492Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4784bf4090ab503db4467c35","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4784bf4090ab503db4467c35: done: 0.021527 sec","job_status":"done","queue_duration_s":2.33257,"scheduling_latency_s":2.332594,"redis_calls":13,"redis_duration_s":0.0037029999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001338,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002365,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013586,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021527,"completed_at":"2026-09-04T07:33:24.492Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2682gitlab # [ 542.964836] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.494Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0404f4b0d4dbfcc3ce26310","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0404f4b0d4dbfcc3ce26310: start","job_status":"start","queue_duration_s":2.356788,"scheduling_latency_s":2.356813}2683gitlab # [ 542.977219] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.517Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0404f4b0d4dbfcc3ce26310","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0404f4b0d4dbfcc3ce26310: done: 0.022337 sec","job_status":"done","queue_duration_s":2.356788,"scheduling_latency_s":2.356813,"redis_calls":13,"redis_duration_s":0.003914,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001241,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002673,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01426,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022337,"completed_at":"2026-09-04T07:33:24.517Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2684gitlab # [ 543.016527] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.519Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cec28647c7e225a64e0408e7","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cec28647c7e225a64e0408e7: start","job_status":"start","queue_duration_s":2.381413,"scheduling_latency_s":2.38144}2685gitlab # [ 543.029047] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.541Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cec28647c7e225a64e0408e7","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cec28647c7e225a64e0408e7: done: 0.022123 sec","job_status":"done","queue_duration_s":2.381413,"scheduling_latency_s":2.38144,"redis_calls":13,"redis_duration_s":0.003566,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001173,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002393,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022123,"completed_at":"2026-09-04T07:33:24.541Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2686gitlab # [ 543.069557] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a55f57463f2562b8555d3009","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a55f57463f2562b8555d3009: start","job_status":"start","queue_duration_s":2.406092,"scheduling_latency_s":2.40612}2687gitlab # [ 543.082018] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.571Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a55f57463f2562b8555d3009","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a55f57463f2562b8555d3009: done: 0.027714 sec","job_status":"done","queue_duration_s":2.406092,"scheduling_latency_s":2.40612,"redis_calls":13,"redis_duration_s":0.006319,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002316,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004003,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016708,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027714,"completed_at":"2026-09-04T07:33:24.571Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2688gitlab # [ 543.123515] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.574Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0497d6f56f9489ce6231ece1","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0497d6f56f9489ce6231ece1: start","job_status":"start","queue_duration_s":2.43628,"scheduling_latency_s":2.43635}2689gitlab # [ 543.137570] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0497d6f56f9489ce6231ece1","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0497d6f56f9489ce6231ece1: done: 0.028616 sec","job_status":"done","queue_duration_s":2.43628,"scheduling_latency_s":2.43635,"redis_calls":13,"redis_duration_s":0.004675,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001575,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0031,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018516,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028616,"completed_at":"2026-09-04T07:33:24.602Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2690gitlab # [ 543.178300] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.605Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d61c77a393a80d2340d0f1e8","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d61c77a393a80d2340d0f1e8: start","job_status":"start","queue_duration_s":2.467823,"scheduling_latency_s":2.467857}2691gitlab # [ 543.191279] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.628Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d61c77a393a80d2340d0f1e8","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d61c77a393a80d2340d0f1e8: done: 0.023204 sec","job_status":"done","queue_duration_s":2.467823,"scheduling_latency_s":2.467857,"redis_calls":13,"redis_duration_s":0.002584,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000906,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001678,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023204,"completed_at":"2026-09-04T07:33:24.628Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2692gitlab # [ 543.233614] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.631Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7032a2dad7aae4a30b6e4a6","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7032a2dad7aae4a30b6e4a6: start","job_status":"start","queue_duration_s":2.49304,"scheduling_latency_s":2.49307}2693gitlab # [ 543.273444] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.654Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7032a2dad7aae4a30b6e4a6","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7032a2dad7aae4a30b6e4a6: done: 0.02306 sec","job_status":"done","queue_duration_s":2.49304,"scheduling_latency_s":2.49307,"redis_calls":13,"redis_duration_s":0.002716,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000868,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001848,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015641,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02306,"completed_at":"2026-09-04T07:33:24.654Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2694gitlab # [ 543.352597] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.655Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"826c4467fa13f178c875b265","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-826c4467fa13f178c875b265: start","job_status":"start","queue_duration_s":2.517721,"scheduling_latency_s":2.517751}2695gitlab # [ 543.367702] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.677Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"826c4467fa13f178c875b265","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-826c4467fa13f178c875b265: done: 0.022213 sec","job_status":"done","queue_duration_s":2.517721,"scheduling_latency_s":2.517751,"redis_calls":13,"redis_duration_s":0.002009,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00071,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001299,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022213,"completed_at":"2026-09-04T07:33:24.677Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2696gitlab # [ 543.409639] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.680Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29a9892e59cfda45d8c6bc18","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29a9892e59cfda45d8c6bc18: start","job_status":"start","queue_duration_s":2.54203,"scheduling_latency_s":2.54206}2697gitlab # [ 543.423061] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.704Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29a9892e59cfda45d8c6bc18","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29a9892e59cfda45d8c6bc18: done: 0.024821 sec","job_status":"done","queue_duration_s":2.54203,"scheduling_latency_s":2.54206,"redis_calls":13,"redis_duration_s":0.002806,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024821,"completed_at":"2026-09-04T07:33:24.704Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2698gitlab # [ 543.463993] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.707Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90fc9b761106c697c6c92274","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90fc9b761106c697c6c92274: start","job_status":"start","queue_duration_s":2.568824,"scheduling_latency_s":2.5695}2699gitlab # [ 543.477752] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.731Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90fc9b761106c697c6c92274","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90fc9b761106c697c6c92274: done: 0.024485 sec","job_status":"done","queue_duration_s":2.568824,"scheduling_latency_s":2.5695,"redis_calls":13,"redis_duration_s":0.002664,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000857,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001807,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0162,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024485,"completed_at":"2026-09-04T07:33:24.731Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2700gitlab # [ 543.518181] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eae5acdb83b3033d057ad5f5","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eae5acdb83b3033d057ad5f5: start","job_status":"start","queue_duration_s":2.59488,"scheduling_latency_s":2.594909}2701gitlab # [ 543.530766] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.756Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eae5acdb83b3033d057ad5f5","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eae5acdb83b3033d057ad5f5: done: 0.02332 sec","job_status":"done","queue_duration_s":2.59488,"scheduling_latency_s":2.594909,"redis_calls":13,"redis_duration_s":0.002434,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000796,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001638,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02332,"completed_at":"2026-09-04T07:33:24.756Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2702gitlab # [ 543.573479] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.758Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13e5fc62c2f0fb7b7cf484d9","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13e5fc62c2f0fb7b7cf484d9: start","job_status":"start","queue_duration_s":2.620308,"scheduling_latency_s":2.620383}2703gitlab # [ 543.587648] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13e5fc62c2f0fb7b7cf484d9","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13e5fc62c2f0fb7b7cf484d9: done: 0.023676 sec","job_status":"done","queue_duration_s":2.620308,"scheduling_latency_s":2.620383,"redis_calls":13,"redis_duration_s":0.001827,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000657,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00117,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014869,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023676,"completed_at":"2026-09-04T07:33:24.781Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2704gitlab # [ 543.628635] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.783Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19c940e9c08f1d7a51612410","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19c940e9c08f1d7a51612410: start","job_status":"start","queue_duration_s":2.645515,"scheduling_latency_s":2.645542}2705gitlab # [ 543.641186] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.803Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19c940e9c08f1d7a51612410","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19c940e9c08f1d7a51612410: done: 0.020312 sec","job_status":"done","queue_duration_s":2.645515,"scheduling_latency_s":2.645542,"redis_calls":13,"redis_duration_s":0.0019429999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0007,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001243,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020312,"completed_at":"2026-09-04T07:33:24.803Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2706gitlab # [ 543.685926] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.805Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9ae8e995049f60e4703e598","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9ae8e995049f60e4703e598: start","job_status":"start","queue_duration_s":2.667612,"scheduling_latency_s":2.667639}2707gitlab # [ 543.699426] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9ae8e995049f60e4703e598","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9ae8e995049f60e4703e598: done: 0.024125 sec","job_status":"done","queue_duration_s":2.667612,"scheduling_latency_s":2.667639,"redis_calls":13,"redis_duration_s":0.002126,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000792,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001334,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024125,"completed_at":"2026-09-04T07:33:24.829Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2708gitlab # [ 543.744880] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c717dd4421afe8b1ca7d1e2d","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c717dd4421afe8b1ca7d1e2d: start","job_status":"start","queue_duration_s":2.69343,"scheduling_latency_s":2.693456}2709gitlab # [ 543.758346] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.854Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c717dd4421afe8b1ca7d1e2d","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c717dd4421afe8b1ca7d1e2d: done: 0.022919 sec","job_status":"done","queue_duration_s":2.69343,"scheduling_latency_s":2.693456,"redis_calls":13,"redis_duration_s":0.002481,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000832,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001649,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015814,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022919,"completed_at":"2026-09-04T07:33:24.854Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2710gitlab # [ 543.798946] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.856Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c91af8f266929d559181271b","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c91af8f266929d559181271b: start","job_status":"start","queue_duration_s":2.718322,"scheduling_latency_s":2.718351}2711gitlab # [ 543.812055] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.879Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c91af8f266929d559181271b","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c91af8f266929d559181271b: done: 0.022799 sec","job_status":"done","queue_duration_s":2.718322,"scheduling_latency_s":2.718351,"redis_calls":13,"redis_duration_s":0.00232,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00078,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00154,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014063,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022799,"completed_at":"2026-09-04T07:33:24.879Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2712gitlab # [ 543.851513] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.880Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf263463c03680a7fe8f4cb1","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf263463c03680a7fe8f4cb1: start","job_status":"start","queue_duration_s":2.742749,"scheduling_latency_s":2.742778}2713gitlab # [ 543.864049] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.904Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf263463c03680a7fe8f4cb1","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf263463c03680a7fe8f4cb1: done: 0.023371 sec","job_status":"done","queue_duration_s":2.742749,"scheduling_latency_s":2.742778,"redis_calls":13,"redis_duration_s":0.002605,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000979,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001626,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016524,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023371,"completed_at":"2026-09-04T07:33:24.904Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2714gitlab # [ 543.906554] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.906Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a87d435802530e2c53b3eba","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a87d435802530e2c53b3eba: start","job_status":"start","queue_duration_s":2.768157,"scheduling_latency_s":2.768186}2715gitlab # [ 543.919891] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.927Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a87d435802530e2c53b3eba","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a87d435802530e2c53b3eba: done: 0.021811 sec","job_status":"done","queue_duration_s":2.768157,"scheduling_latency_s":2.768186,"redis_calls":13,"redis_duration_s":0.002214,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000765,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001449,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021811,"completed_at":"2026-09-04T07:33:24.927Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2716gitlab # [ 543.960332] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.929Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6042ddd8b1216f5ebcb10fe","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6042ddd8b1216f5ebcb10fe: start","job_status":"start","queue_duration_s":2.791947,"scheduling_latency_s":2.79197}2717gitlab # [ 543.972995] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.950Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6042ddd8b1216f5ebcb10fe","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6042ddd8b1216f5ebcb10fe: done: 0.020779 sec","job_status":"done","queue_duration_s":2.791947,"scheduling_latency_s":2.79197,"redis_calls":13,"redis_duration_s":0.001915,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000711,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001204,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020779,"completed_at":"2026-09-04T07:33:24.950Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2718gitlab # [ 544.015365] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.953Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bcd76bf5a1b4631349de958d","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bcd76bf5a1b4631349de958d: start","job_status":"start","queue_duration_s":2.815065,"scheduling_latency_s":2.815091}2719gitlab # [ 544.028787] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bcd76bf5a1b4631349de958d","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bcd76bf5a1b4631349de958d: done: 0.021396 sec","job_status":"done","queue_duration_s":2.815065,"scheduling_latency_s":2.815091,"redis_calls":13,"redis_duration_s":0.0021910000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000799,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001392,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014483,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021396,"completed_at":"2026-09-04T07:33:24.974Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2720gitlab # [ 544.070948] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:24.976Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85b1a508529a89b53f2d99f2","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85b1a508529a89b53f2d99f2: start","job_status":"start","queue_duration_s":2.838075,"scheduling_latency_s":2.838097}2721gitlab # [ 544.084524] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85b1a508529a89b53f2d99f2","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85b1a508529a89b53f2d99f2: done: 0.024845 sec","job_status":"done","queue_duration_s":2.838075,"scheduling_latency_s":2.838097,"redis_calls":13,"redis_duration_s":0.002539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001603,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024845,"completed_at":"2026-09-04T07:33:25.000Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2722gitlab # [ 544.124537] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.002Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79574420bddc3615fc67dfec","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79574420bddc3615fc67dfec: start","job_status":"start","queue_duration_s":2.864742,"scheduling_latency_s":2.864768}2723gitlab # [ 544.136642] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79574420bddc3615fc67dfec","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79574420bddc3615fc67dfec: done: 0.021375 sec","job_status":"done","queue_duration_s":2.864742,"scheduling_latency_s":2.864768,"redis_calls":13,"redis_duration_s":0.0021089999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000693,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001416,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013988,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021375,"completed_at":"2026-09-04T07:33:25.024Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2724gitlab # [ 544.176897] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.025Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ebbbfd45733be16a242fdbc","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ebbbfd45733be16a242fdbc: start","job_status":"start","queue_duration_s":2.887677,"scheduling_latency_s":2.887703}2725gitlab # [ 544.189662] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.046Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ebbbfd45733be16a242fdbc","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ebbbfd45733be16a242fdbc: done: 0.021119 sec","job_status":"done","queue_duration_s":2.887677,"scheduling_latency_s":2.887703,"redis_calls":13,"redis_duration_s":0.002137,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000707,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00143,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021119,"completed_at":"2026-09-04T07:33:25.046Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2726gitlab # [ 544.232107] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.048Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8be0ab89537e582ed410fa8","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8be0ab89537e582ed410fa8: start","job_status":"start","queue_duration_s":2.910965,"scheduling_latency_s":2.91099}2727gitlab # [ 544.245587] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.072Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8be0ab89537e582ed410fa8","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8be0ab89537e582ed410fa8: done: 0.023077 sec","job_status":"done","queue_duration_s":2.910965,"scheduling_latency_s":2.91099,"redis_calls":13,"redis_duration_s":0.002299,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001397,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023077,"completed_at":"2026-09-04T07:33:25.071Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2728gitlab # [ 544.284953] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c41428530baac691b5a6d477","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c41428530baac691b5a6d477: start","job_status":"start","queue_duration_s":2.935687,"scheduling_latency_s":2.935713}2729gitlab # [ 544.299992] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.095Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c41428530baac691b5a6d477","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c41428530baac691b5a6d477: done: 0.022303 sec","job_status":"done","queue_duration_s":2.935687,"scheduling_latency_s":2.935713,"redis_calls":13,"redis_duration_s":0.0019290000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000695,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001234,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014188,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022303,"completed_at":"2026-09-04T07:33:25.095Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2730gitlab # [ 544.348458] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.097Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42520e26d826e76072bbd7bc","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42520e26d826e76072bbd7bc: start","job_status":"start","queue_duration_s":2.959542,"scheduling_latency_s":2.959568}2731gitlab # [ 544.363508] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.118Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42520e26d826e76072bbd7bc","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42520e26d826e76072bbd7bc: done: 0.021022 sec","job_status":"done","queue_duration_s":2.959542,"scheduling_latency_s":2.959568,"redis_calls":13,"redis_duration_s":0.002286,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000765,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001521,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01414,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021022,"completed_at":"2026-09-04T07:33:25.118Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2732gitlab # [ 544.408963] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.120Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5582b32a6d696983411ab0cf","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5582b32a6d696983411ab0cf: start","job_status":"start","queue_duration_s":2.982432,"scheduling_latency_s":2.982458}2733gitlab # [ 544.423697] nix-daemon[4116]: accepted connection from pid 4881, user nixbot2734gitlab # [ 544.424944] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.143Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5582b32a6d696983411ab0cf","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5582b32a6d696983411ab0cf: done: 0.023384 sec","job_status":"done","queue_duration_s":2.982432,"scheduling_latency_s":2.982458,"redis_calls":13,"redis_duration_s":0.0021349999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000748,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001387,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015369,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023384,"completed_at":"2026-09-04T07:33:25.143Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2735gitlab # [ 544.465577] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.145Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ce7e40cb5b0d124d6d821d1","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ce7e40cb5b0d124d6d821d1: start","job_status":"start","queue_duration_s":3.007884,"scheduling_latency_s":3.007911}2736gitlab # [ 544.478477] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.169Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ce7e40cb5b0d124d6d821d1","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ce7e40cb5b0d124d6d821d1: done: 0.023323 sec","job_status":"done","queue_duration_s":3.007884,"scheduling_latency_s":3.007911,"redis_calls":13,"redis_duration_s":0.002568,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000826,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001742,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016437,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023323,"completed_at":"2026-09-04T07:33:25.169Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2737gitlab # [ 544.519903] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.171Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40c70c8a2e06f40cc1bc3f9b","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40c70c8a2e06f40cc1bc3f9b: start","job_status":"start","queue_duration_s":3.033339,"scheduling_latency_s":3.033368}2738gitlab # [ 544.533134] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.193Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40c70c8a2e06f40cc1bc3f9b","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40c70c8a2e06f40cc1bc3f9b: done: 0.022503 sec","job_status":"done","queue_duration_s":3.033339,"scheduling_latency_s":3.033368,"redis_calls":13,"redis_duration_s":0.002052,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000747,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001305,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014586,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022503,"completed_at":"2026-09-04T07:33:25.193Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2739gitlab # [ 544.574531] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.195Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3a85811d2bbf187e900fdab","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3a85811d2bbf187e900fdab: start","job_status":"start","queue_duration_s":3.057706,"scheduling_latency_s":3.057729}2740gitlab # [ 544.587677] gitaly[896]: time="2026-09-04T07:33:26.376Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNCCMMGB46711QER17ZEB1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:33:56.074" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:26.375" grpc.time_ms=1.026 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2741gitlab # [ 544.600709] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.219Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3a85811d2bbf187e900fdab","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3a85811d2bbf187e900fdab: done: 0.023698 sec","job_status":"done","queue_duration_s":3.057706,"scheduling_latency_s":3.057729,"redis_calls":13,"redis_duration_s":0.002512,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00094,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001572,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016871,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023698,"completed_at":"2026-09-04T07:33:25.219Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2742gitlab # [ 544.641230] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.221Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44168a3027dd8a0d4537106c","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44168a3027dd8a0d4537106c: start","job_status":"start","queue_duration_s":3.083068,"scheduling_latency_s":3.083093}2743gitlab # [ 544.654307] gitaly[896]: time="2026-09-04T07:33:26.467Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=6 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNCCMMGB46711QER17ZEB1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:33:36.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:26.453" grpc.time_ms=13.996 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2744gitlab # [ 544.672518] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.247Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44168a3027dd8a0d4537106c","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44168a3027dd8a0d4537106c: done: 0.026061 sec","job_status":"done","queue_duration_s":3.083068,"scheduling_latency_s":3.083093,"redis_calls":13,"redis_duration_s":0.0031390000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001319,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00182,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026061,"completed_at":"2026-09-04T07:33:25.247Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2745gitlab # [ 544.718126] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.249Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d75c93ee5f2fc27ad2a74b58","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d75c93ee5f2fc27ad2a74b58: start","job_status":"start","queue_duration_s":3.110978,"scheduling_latency_s":3.111004}2746gitlab # [ 544.733290] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:33:26 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 2562747gitlab # [ 544.736734] nixbot[3856]: {"ts": "2026-09-04T07:33:26.556Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 \"HTTP/1.1 201 Created\""}2748gitlab # [ 544.739757] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d75c93ee5f2fc27ad2a74b58","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d75c93ee5f2fc27ad2a74b58: done: 0.022792 sec","job_status":"done","queue_duration_s":3.110978,"scheduling_latency_s":3.111004,"redis_calls":13,"redis_duration_s":0.002027,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000744,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001283,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014952,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022792,"completed_at":"2026-09-04T07:33:25.271Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2749gitlab # [ 544.781805] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dfbe01dcd7a4c34ede1a6a2d","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dfbe01dcd7a4c34ede1a6a2d: start","job_status":"start","queue_duration_s":3.13534,"scheduling_latency_s":3.135362}2750gitlab # [ 544.795098] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.297Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dfbe01dcd7a4c34ede1a6a2d","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dfbe01dcd7a4c34ede1a6a2d: done: 0.024097 sec","job_status":"done","queue_duration_s":3.13534,"scheduling_latency_s":3.135362,"redis_calls":13,"redis_duration_s":0.00247,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000759,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001711,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015718,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024097,"completed_at":"2026-09-04T07:33:25.297Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2751gitlab # [ 544.835403] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b4d7cbba4c3085283ec7435","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b4d7cbba4c3085283ec7435: start","job_status":"start","queue_duration_s":3.161068,"scheduling_latency_s":3.161135}2752gitlab # [ 544.848078] gitaly[896]: time="2026-09-04T07:33:26.668Z" level=info msg="finished unary call with code OK" catfile.duration_ms=4 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=4 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNCCX10H4CZG7RQ05WFYQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:33:56.662" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:26.663" grpc.time_ms=5.475 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2753gitlab # [ 544.860698] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.322Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b4d7cbba4c3085283ec7435","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b4d7cbba4c3085283ec7435: done: 0.023022 sec","job_status":"done","queue_duration_s":3.161068,"scheduling_latency_s":3.161135,"redis_calls":13,"redis_duration_s":0.002427,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000856,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001571,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015832,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023022,"completed_at":"2026-09-04T07:33:25.321Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2754gitlab # [ 544.900079] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6443bbee31a1ef96f6e3f98e","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6443bbee31a1ef96f6e3f98e: start","job_status":"start","queue_duration_s":3.18707,"scheduling_latency_s":3.187097}2755gitlab # [ 544.912392] gitaly[896]: time="2026-09-04T07:33:26.744Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNCCX10H4CZG7RQ05WFYQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:33:36.193" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:26.733" grpc.time_ms=11.076 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2756gitlab # [ 544.926327] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.350Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6443bbee31a1ef96f6e3f98e","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6443bbee31a1ef96f6e3f98e: done: 0.025254 sec","job_status":"done","queue_duration_s":3.18707,"scheduling_latency_s":3.187097,"redis_calls":13,"redis_duration_s":0.002402,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00099,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001412,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016708,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025254,"completed_at":"2026-09-04T07:33:25.350Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2757gitlab # [ 544.968996] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.390Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"afb488c0966c79a5a45aca10","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-afb488c0966c79a5a45aca10: start","job_status":"start","queue_duration_s":3.25193,"scheduling_latency_s":3.251992}2758gitlab # [ 544.982593] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.604Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"afb488c0966c79a5a45aca10","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-afb488c0966c79a5a45aca10: done: 0.214511 sec","job_status":"done","queue_duration_s":3.25193,"scheduling_latency_s":3.251992,"redis_calls":13,"redis_duration_s":0.0040490000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002395,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001654,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01892,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.214511,"completed_at":"2026-09-04T07:33:25.604Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2759gitlab # [ 545.024131] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:25.706Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04146d2b570303ab13b29664","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04146d2b570303ab13b29664: start","job_status":"start","queue_duration_s":3.568793,"scheduling_latency_s":3.568839}2760gitlab # [ 545.037047] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:33:26 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2922761gitlab # [ 545.039798] nixbot[3856]: {"ts": "2026-09-04T07:33:26.856Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 \"HTTP/1.1 201 Created\""}2762gitlab # [ 545.042944] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:26.534Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04146d2b570303ab13b29664","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04146d2b570303ab13b29664: done: 0.827431 sec","job_status":"done","queue_duration_s":3.568793,"scheduling_latency_s":3.568839,"redis_calls":13,"redis_duration_s":0.307815,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.102969,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.204846,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037654,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.827431,"completed_at":"2026-09-04T07:33:26.534Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2763gitlab # [ 545.085570] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:26.631Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"399559018c02c03657b600a2","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-399559018c02c03657b600a2: start","job_status":"start","queue_duration_s":4.493371,"scheduling_latency_s":4.493409}2764gitlab # [ 545.132690] gitaly[896]: time="2026-09-04T07:33:27.018Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNCD6MEJNBS8JXZM13R2FM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:33:57.017" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:27.017" grpc.time_ms=0.904 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2765gitlab # [ 545.212893] gitaly[896]: time="2026-09-04T07:33:27.098Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1NNCD6MEJNBS8JXZM13R2FM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:33:37.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:27.082" grpc.time_ms=15.846 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2766gitlab # [ 545.230072] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:27.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"399559018c02c03657b600a2","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-399559018c02c03657b600a2: done: 0.479791 sec","job_status":"done","queue_duration_s":4.493371,"scheduling_latency_s":4.493409,"redis_calls":13,"redis_duration_s":0.08332400000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0011,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.082224,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019413,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.479791,"completed_at":"2026-09-04T07:33:27.111Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2767gitlab # [ 545.270320] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:27.114Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1a1eee89423076aeba24ce7","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1a1eee89423076aeba24ce7: start","job_status":"start","queue_duration_s":4.976457,"scheduling_latency_s":4.976493}2768gitlab # [ 545.354245] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:33:27 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 3692769gitlab # [ 545.359695] nixbot[3856]: {"ts": "2026-09-04T07:33:27.240Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 \"HTTP/1.1 201 Created\""}2770gitlab # [ 545.389366] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:27.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1a1eee89423076aeba24ce7","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1a1eee89423076aeba24ce7: done: 0.160115 sec","job_status":"done","queue_duration_s":4.976457,"scheduling_latency_s":4.976493,"redis_calls":13,"redis_duration_s":0.00659,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002079,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.160115,"completed_at":"2026-09-04T07:33:27.274Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2771gitlab # [ 545.432190] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:27.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46c80b4bf61d650a17d861da","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46c80b4bf61d650a17d861da: start","job_status":"start","queue_duration_s":5.161583,"scheduling_latency_s":5.161733}2772gitlab # [ 545.613244] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:27.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46c80b4bf61d650a17d861da","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46c80b4bf61d650a17d861da: done: 0.198474 sec","job_status":"done","queue_duration_s":5.161583,"scheduling_latency_s":5.161733,"redis_calls":13,"redis_duration_s":0.015499,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.013559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00194,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024756,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.198474,"completed_at":"2026-09-04T07:33:27.497Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2773gitlab # [ 545.662479] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:27.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0564a3870b49dfbc11ac0006","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0564a3870b49dfbc11ac0006: start","job_status":"start","queue_duration_s":5.365749,"scheduling_latency_s":5.365821}2774gitlab # [ 545.815867] gitaly[896]: time="2026-09-04T07:33:27.699Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=3 command.system_time_ms=17 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNCDWXF7S4VZ5NQ6EJ93S7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:33:27.675" grpc.time_ms=23.042 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2775gitlab # [ 545.853729] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:33:27 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1182776gitlab # [ 545.955712] gitaly[896]: time="2026-09-04T07:33:27.841Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNCE14BSZS4XGEN563RQFY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:33:27.827" pid=896 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2777gitlab # [ 545.987246] gitaly[896]: time="2026-09-04T07:33:27.841Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=5 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNCE14BSZS4XGEN563RQFY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:33:27.827" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2778gitlab # [ 546.012380] gitlab-workhorse[816]: time="2026-09-04T07:33:27Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672779gitlab # [ 546.015730] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:33:27 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1262780gitlab # [ 546.018971] gitaly[896]: time="2026-09-04T07:33:27.842Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=5 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNCE14BSZS4XGEN563RQFY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:33:27.827" grpc.time_ms=14.267 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2781gitlab # [ 546.040310] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:27.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0564a3870b49dfbc11ac0006","created_at":"2026-09-04T07:33:21.606Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-22d15926441942e2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba088eac6454667fd41199ddbc2c819c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.137Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0564a3870b49dfbc11ac0006: done: 0.413794 sec","job_status":"done","queue_duration_s":5.365749,"scheduling_latency_s":5.365821,"redis_calls":13,"redis_duration_s":0.016138,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003675,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.012463,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022623,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.413794,"completed_at":"2026-09-04T07:33:27.917Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2782gitlab # [ 546.093844] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:27.945Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"faa43093b47d15b410b3f34a","created_at":"2026-09-04T07:33:22.109Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6ef8e75138684617c2c63e33bae5befb","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.143Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-faa43093b47d15b410b3f34a: start","job_status":"start","queue_duration_s":5.801197,"scheduling_latency_s":5.801296}2783gitlab # [ 546.164169] gitaly[896]: time="2026-09-04T07:33:28.049Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1NNCE6V2J8BMY6V9BPVSH43 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:33:28.036" grpc.time_ms=12.383 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2784gitlab # [ 546.180485] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:33:28 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1512785gitlab # [ 546.303125] gitaly[896]: time="2026-09-04T07:33:28.189Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNCEC6TEBZW0Z0A8KKM4RC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:33:28.169" pid=896 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc2786gitlab # [ 546.333770] gitaly[896]: time="2026-09-04T07:33:28.189Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNCEC6TEBZW0Z0A8KKM4RC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:33:28.169" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2787gitlab # [ 546.361888] gitlab-workhorse[816]: time="2026-09-04T07:33:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672788gitlab # [ 546.365510] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/09/04:07:33:28 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1192789gitlab # [ 546.369148] gitaly[896]: time="2026-09-04T07:33:28.189Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNCEC6TEBZW0Z0A8KKM4RC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:33:28.169" grpc.time_ms=19.988 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2790gitlab # [ 546.394847] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:28.254Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"faa43093b47d15b410b3f34a","created_at":"2026-09-04T07:33:22.109Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6ef8e75138684617c2c63e33bae5befb","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.143Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-faa43093b47d15b410b3f34a: done: 0.309845 sec","job_status":"done","queue_duration_s":5.801197,"scheduling_latency_s":5.801296,"redis_calls":11,"redis_duration_s":0.029866,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001285,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009535,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.019046,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00101136,"exclusive_lock_hold_duration_s":0.00987986,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.309845,"completed_at":"2026-09-04T07:33:28.254Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031638,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2791gitlab # [ 546.455034] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:28.264Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"4f834c2d0e10229028e3660e","created_at":"2026-09-04T07:33:22.176Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17bb253d1a5620c69ea26af40822b092","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.200Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-4f834c2d0e10229028e3660e: start","job_status":"start","queue_duration_s":6.064227,"scheduling_latency_s":6.064262}2792gitlab # [ 546.473576] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:28.305Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"4f834c2d0e10229028e3660e","created_at":"2026-09-04T07:33:22.176Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17bb253d1a5620c69ea26af40822b092","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.200Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-4f834c2d0e10229028e3660e: done: 0.040923 sec","job_status":"done","queue_duration_s":6.064227,"scheduling_latency_s":6.064262,"redis_calls":9,"redis_duration_s":0.00301,"redis_read_bytes":7,"redis_write_bytes":1119,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000636,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001778,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000596,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040923,"completed_at":"2026-09-04T07:33:28.305Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001122,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2793gitlab # [ 546.519453] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:28.308Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"71b6dd4538666633e05bec68","created_at":"2026-09-04T07:33:22.235Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e568681926a103a3beed16236798e820","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.252Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-71b6dd4538666633e05bec68: start","job_status":"start","queue_duration_s":6.055857,"scheduling_latency_s":6.055889}2794gitlab # [ 546.534739] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:28.331Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}2795gitlab # [ 546.538387] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:28.339Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"71b6dd4538666633e05bec68","created_at":"2026-09-04T07:33:22.235Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e568681926a103a3beed16236798e820","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.252Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-71b6dd4538666633e05bec68: done: 0.031778 sec","job_status":"done","queue_duration_s":6.055857,"scheduling_latency_s":6.055889,"redis_calls":9,"redis_duration_s":0.002312,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000461,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001269,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000582,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020747,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031778,"completed_at":"2026-09-04T07:33:28.339Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000889,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2796gitlab # [ 546.584815] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:28.341Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"76f8d32f095a04c49a7aa327","created_at":"2026-09-04T07:33:22.486Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a650a748b311e70654da16e3b458efb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.505Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-76f8d32f095a04c49a7aa327: start","job_status":"start","queue_duration_s":5.836053,"scheduling_latency_s":5.836082}2797gitlab # [ 546.598800] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:28.443Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"76f8d32f095a04c49a7aa327","created_at":"2026-09-04T07:33:22.486Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a650a748b311e70654da16e3b458efb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.505Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-76f8d32f095a04c49a7aa327: done: 0.101658 sec","job_status":"done","queue_duration_s":5.836053,"scheduling_latency_s":5.836082,"redis_calls":18,"redis_duration_s":0.0075049999999999995,"redis_read_bytes":20,"redis_write_bytes":4694,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001465,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000696,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3011,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.004083,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001261,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.081798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.101658,"completed_at":"2026-09-04T07:33:28.443Z","load_balancing_strategy":"primary","db_duration_s":0.004373,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2798gitlab # [ 546.646013] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:28.450Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"20d7c29e2d3393ff6212f96e","created_at":"2026-09-04T07:33:22.544Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"97f60a483c5927235bdee037ecbcf125","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.571Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-20d7c29e2d3393ff6212f96e: start","job_status":"start","queue_duration_s":5.878965,"scheduling_latency_s":5.879017}2799gitlab # [ 546.663323] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:28.482Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}2800gitlab # [ 546.667657] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:28.503Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"20d7c29e2d3393ff6212f96e","created_at":"2026-09-04T07:33:22.544Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"97f60a483c5927235bdee037ecbcf125","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.571Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-20d7c29e2d3393ff6212f96e: done: 0.053645 sec","job_status":"done","queue_duration_s":5.878965,"scheduling_latency_s":5.879017,"redis_calls":9,"redis_duration_s":0.004068,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000868,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0023,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0009,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030227,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.053645,"completed_at":"2026-09-04T07:33:28.503Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001366,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2801gitlab # [ 546.712106] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:28.506Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"5a9db2c9bbf4a7a48d29093e","created_at":"2026-09-04T07:33:22.621Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b8ff5cf3a51bc22030c9b81737d07d15","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.661Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-5a9db2c9bbf4a7a48d29093e: start","job_status":"start","queue_duration_s":5.844871,"scheduling_latency_s":5.844958}2802gitlab # [ 546.759995] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:28.645Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"5a9db2c9bbf4a7a48d29093e","created_at":"2026-09-04T07:33:22.621Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b8ff5cf3a51bc22030c9b81737d07d15","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.661Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-5a9db2c9bbf4a7a48d29093e: done: 0.1388 sec","job_status":"done","queue_duration_s":5.844871,"scheduling_latency_s":5.844958,"redis_calls":11,"redis_duration_s":0.006253,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001019,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0025,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002734,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.053,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.053,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063907,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0015547,"exclusive_lock_hold_duration_s":0.04805536,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.1388,"completed_at":"2026-09-04T07:33:28.644Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.057713,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2803gitlab # [ 546.810264] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:28.648Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"1feae01bd6c5f6fdb32eec10","created_at":"2026-09-04T07:33:22.695Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0707d7ce9cc22d566f1b7cd96b610d6d","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.732Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-1feae01bd6c5f6fdb32eec10: start","job_status":"start","queue_duration_s":5.916328,"scheduling_latency_s":5.91637}2804gitlab # [ 547.414616] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:29.299Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"1feae01bd6c5f6fdb32eec10","created_at":"2026-09-04T07:33:22.695Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0707d7ce9cc22d566f1b7cd96b610d6d","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.732Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-1feae01bd6c5f6fdb32eec10: done: 0.651565 sec","job_status":"done","queue_duration_s":5.916328,"scheduling_latency_s":5.91637,"redis_calls":564,"redis_duration_s":0.17532399999999998,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000915,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002901,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.171508,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.542326,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.651565,"completed_at":"2026-09-04T07:33:29.299Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001256,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2805gitlab # [ 547.538712] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:29.303Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"9b7a3b81b4ee61408204340f","created_at":"2026-09-04T07:33:22.770Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f1a73a09461c844f43e232ea760e15fb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.794Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-9b7a3b81b4ee61408204340f: start","job_status":"start","queue_duration_s":6.508579,"scheduling_latency_s":6.508617}2806gitlab # [ 547.566422] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:29.395Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"9b7a3b81b4ee61408204340f","created_at":"2026-09-04T07:33:22.770Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f1a73a09461c844f43e232ea760e15fb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.794Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-9b7a3b81b4ee61408204340f: done: 0.091634 sec","job_status":"done","queue_duration_s":6.508579,"scheduling_latency_s":6.508617,"redis_calls":11,"redis_duration_s":0.007195,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001268,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002474,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003453,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063629,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00269526,"exclusive_lock_hold_duration_s":0.02370448,"duration_s":0.091634,"completed_at":"2026-09-04T07:33:29.394Z","load_balancing_strategy":"primary","db_duration_s":0.007578,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2807gitlab # [ 547.633127] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:29.399Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"a0220a0d3d3002cdb1b54fdc","created_at":"2026-09-04T07:33:22.823Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e9168c8ca0539952b14ff19ef320611e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.866Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-a0220a0d3d3002cdb1b54fdc: start","job_status":"start","queue_duration_s":6.533861,"scheduling_latency_s":6.533914}2808gitlab # [ 547.652790] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:29.427Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}2809gitlab # [ 547.656705] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:29.444Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"a0220a0d3d3002cdb1b54fdc","created_at":"2026-09-04T07:33:22.823Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e9168c8ca0539952b14ff19ef320611e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:22.866Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-a0220a0d3d3002cdb1b54fdc: done: 0.045093 sec","job_status":"done","queue_duration_s":6.533861,"scheduling_latency_s":6.533914,"redis_calls":9,"redis_duration_s":0.00279,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00066,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001569,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000561,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.045093,"completed_at":"2026-09-04T07:33:29.444Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001144,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2810gitlab # [ 547.704376] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:29.448Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"fee56b6188918969af7c57f4","created_at":"2026-09-04T07:33:22.905Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"61cbb0122b87b04e25c87bf4e4cea92d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:33:22.961Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-fee56b6188918969af7c57f4: start","job_status":"start","queue_duration_s":6.487102,"scheduling_latency_s":6.487143}2811gitlab # [ 547.717948] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:29.472Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}2812gitlab # [ 547.721499] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:29.487Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"fee56b6188918969af7c57f4","created_at":"2026-09-04T07:33:22.905Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"61cbb0122b87b04e25c87bf4e4cea92d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:33:22.961Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-fee56b6188918969af7c57f4: done: 0.039552 sec","job_status":"done","queue_duration_s":6.487102,"scheduling_latency_s":6.487143,"redis_calls":9,"redis_duration_s":0.003337,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000815,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001948,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000574,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024539,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039552,"completed_at":"2026-09-04T07:33:29.487Z","load_balancing_strategy":"primary","db_duration_s":0.000904,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2813gitlab # [ 547.765536] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:29.490Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"e04ad440716b7dc91d067f2e","created_at":"2026-09-04T07:33:22.995Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3a4aa258684f7edd193b3b427796759c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:23.038Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-e04ad440716b7dc91d067f2e: start","job_status":"start","queue_duration_s":6.451273,"scheduling_latency_s":6.45162}2814gitlab # [ 547.781270] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:29.585Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"e04ad440716b7dc91d067f2e","created_at":"2026-09-04T07:33:22.995Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3a4aa258684f7edd193b3b427796759c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:23.038Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-e04ad440716b7dc91d067f2e: done: 0.095453 sec","job_status":"done","queue_duration_s":6.451273,"scheduling_latency_s":6.45162,"redis_calls":28,"redis_duration_s":0.008069,"redis_read_bytes":36,"redis_write_bytes":10603,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001094,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":680,"redis_queues_calls":2,"redis_queues_duration_s":0.000487,"redis_queues_read_bytes":3,"redis_queues_write_bytes":8315,"redis_queues_metadata_calls":16,"redis_queues_metadata_duration_s":0.004553,"redis_queues_metadata_read_bytes":24,"redis_queues_metadata_write_bytes":1162,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001935,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":446,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.068045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00110146,"duration_s":0.095453,"completed_at":"2026-09-04T07:33:29.585Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005194,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2815gitlab # [ 547.832845] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:29.590Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"cbcb42b741a84f1f736c1386","created_at":"2026-09-04T07:33:23.125Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"08ebe347530b269280acb4dfc110c529","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:33:23.185Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-cbcb42b741a84f1f736c1386: start","job_status":"start","queue_duration_s":6.40506,"scheduling_latency_s":6.405159}2816gitlab # [ 547.846740] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:29.711Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"cbcb42b741a84f1f736c1386","created_at":"2026-09-04T07:33:23.125Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"08ebe347530b269280acb4dfc110c529","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:33:23.185Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-cbcb42b741a84f1f736c1386: done: 0.121084 sec","job_status":"done","queue_duration_s":6.40506,"scheduling_latency_s":6.405159,"redis_calls":9,"redis_duration_s":0.006618,"redis_read_bytes":7,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00123,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003627,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001761,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.121084,"completed_at":"2026-09-04T07:33:29.711Z","load_balancing_strategy":"primary","db_duration_s":0.009819,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2817gitlab # [ 547.888113] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:29.716Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"ab4621a314d8fcb280999498","created_at":"2026-09-04T07:33:26.518Z","trace_propagation_headers":{"sentry-trace":"deb2600f5f4041d3bbc661226b6a29b8-12871a59bcb04bba","baggage":"sentry-trace_id=deb2600f5f4041d3bbc661226b6a29b8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNCCMMGB46711QER17ZEB1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:26.523Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ab4621a314d8fcb280999498: start","job_status":"start","queue_duration_s":3.192324,"scheduling_latency_s":3.192376}2818gitlab # [ 548.294373] gitaly[896]: time="2026-09-04T07:33:30.179Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNCCMMGB46711QER17ZEB1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:33:30.176" grpc.time_ms=2.304 pid=896 span.kind=server system=grpc2819gitlab # [ 548.373269] gitaly[896]: time="2026-09-04T07:33:30.259Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNCCMMGB46711QER17ZEB1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:33:30.257" grpc.time_ms=1.819 pid=896 span.kind=server system=grpc2820gitlab # [ 548.438557] gitaly[896]: time="2026-09-04T07:33:30.324Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNCCMMGB46711QER17ZEB1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:33:30.322" grpc.time_ms=1.801 pid=896 span.kind=server system=grpc2821gitlab # [ 548.469249] gitaly[896]: time="2026-09-04T07:33:30.331Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNCCMMGB46711QER17ZEB1 forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:34:00.102" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:30.103" operations="[repack_refs]" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2822gitlab # [ 548.495594] gitaly[896]: time="2026-09-04T07:33:30.336Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNCCMMGB46711QER17ZEB1 diskcache=f92624fb-7b4f-4d8d-bc9d-f3bc6dfdd892 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:34:00.102" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:30.103" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2823gitlab # [ 548.517150] gitaly[896]: time="2026-09-04T07:33:30.337Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=245 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7720 command.oublock=0 command.real_time_ms=225 command.spawn_token_fork_ms=1 command.system_time_ms=138 command.user_time_ms=107 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNCCMMGB46711QER17ZEB1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:34:00.102" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:30.103" grpc.time_ms=233.428 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2824gitlab # [ 548.543852] gitaly[896]: time="2026-09-04T07:33:30.343Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNCCMMGB46711QER17ZEB1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:34:00.102" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:30.103" pid=896 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-09-04 07:30:40.544487 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2825gitlab # [ 548.563837] gitaly[896]: time="2026-09-04T07:33:30.393Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNCCMMGB46711QER17ZEB1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:34:00.102" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:30.103" pid=896 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2826gitlab # [ 548.585265] gitaly[896]: time="2026-09-04T07:33:30.393Z" level=info msg="optimized repository" clean_stale_data_time=49.84266ms clean_work_trees_time="281.26µs" commit_graph_time="1.04µs" correlation_id=01M1NNCCMMGB46711QER17ZEB1 gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="2.66µs" pid=896 prune_time=300ns relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="2.24µs" storage_name=default system=housekeeping total_time=50.17942ms2827gitlab # [ 548.594606] gitaly[896]: time="2026-09-04T07:33:30.394Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNCCMMGB46711QER17ZEB1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:34:00.102" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:33:30.103" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2828gitlab # [ 548.659574] gitaly[896]: time="2026-09-04T07:33:30.545Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNCCMMGB46711QER17ZEB1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:34:00.542" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:30.543" grpc.time_ms=2.093 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2829gitlab # [ 548.731162] gitaly[896]: time="2026-09-04T07:33:30.617Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNCCMMGB46711QER17ZEB1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:34:00.614" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:33:30.615" grpc.time_ms=1.508 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2830gitlab # [ 548.769471] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:30.635Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"ab4621a314d8fcb280999498","created_at":"2026-09-04T07:33:26.518Z","trace_propagation_headers":{"sentry-trace":"deb2600f5f4041d3bbc661226b6a29b8-12871a59bcb04bba","baggage":"sentry-trace_id=deb2600f5f4041d3bbc661226b6a29b8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNCCMMGB46711QER17ZEB1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:26.523Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3873,"job_status":"rescheduled","message":"PipelineProcessWorker JID-ab4621a314d8fcb280999498: rescheduled"}2831gitlab # [ 548.803639] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:30.649Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"ab4621a314d8fcb280999498","created_at":"2026-09-04T07:33:26.518Z","trace_propagation_headers":{"sentry-trace":"deb2600f5f4041d3bbc661226b6a29b8-12871a59bcb04bba","baggage":"sentry-trace_id=deb2600f5f4041d3bbc661226b6a29b8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNCCMMGB46711QER17ZEB1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:26.523Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ab4621a314d8fcb280999498: done: 0.933099 sec","job_status":"done","queue_duration_s":3.192324,"scheduling_latency_s":3.192376,"gitaly_calls":3,"gitaly_duration_s":0.252979,"redis_calls":76,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.06204,"redis_read_bytes":168,"redis_write_bytes":21328,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.003332,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.003157,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.016167,"redis_queues_read_bytes":37,"redis_queues_write_bytes":14466,"redis_queues_metadata_calls":20,"redis_queues_metadata_duration_s":0.029539,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3301,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.001436,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001472,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.003605,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.209,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.039,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.046,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.088,"db_ci_duration_s":0.12,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.442987,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.75154564,"duration_s":0.933099,"completed_at":"2026-09-04T07:33:30.649Z","load_balancing_strategy":"primary","db_duration_s":0.221865,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2832gitlab # [ 548.894246] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:30.651Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"72d438e61cadfb7f8ae38e1a","created_at":"2026-09-04T07:33:28.368Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-98409ceaa5d64807","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9a650a748b311e70654da16e3b458efb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:28.416Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-72d438e61cadfb7f8ae38e1a: start","job_status":"start","queue_duration_s":2.235457,"scheduling_latency_s":2.23549}2833gitlab # [ 548.910947] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:30.683Z","message":"No existing merge request to be cleaned up."}2834gitlab # [ 548.913197] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:30.706Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"72d438e61cadfb7f8ae38e1a","created_at":"2026-09-04T07:33:28.368Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-98409ceaa5d64807","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9a650a748b311e70654da16e3b458efb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:28.416Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-72d438e61cadfb7f8ae38e1a: done: 0.054942 sec","job_status":"done","queue_duration_s":2.235457,"scheduling_latency_s":2.23549,"redis_calls":12,"redis_duration_s":0.004476,"redis_read_bytes":10,"redis_write_bytes":1323,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000682,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002259,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.054942,"completed_at":"2026-09-04T07:33:30.706Z","load_balancing_strategy":"primary","db_duration_s":0.008882,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2835gitlab # [ 548.957632] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:30.709Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"dfff84b30e06bb882583fa49","created_at":"2026-09-04T07:33:28.368Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-98409ceaa5d64807","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9a650a748b311e70654da16e3b458efb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:28.416Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-dfff84b30e06bb882583fa49: start","job_status":"start","queue_duration_s":2.293017,"scheduling_latency_s":2.293054}2836gitlab # [ 548.970095] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:30.728Z","message":"No existing merge request to be cleaned up."}2837gitlab # [ 548.971802] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:30.748Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"dfff84b30e06bb882583fa49","created_at":"2026-09-04T07:33:28.368Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-98409ceaa5d64807","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9a650a748b311e70654da16e3b458efb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:28.416Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-dfff84b30e06bb882583fa49: done: 0.039105 sec","job_status":"done","queue_duration_s":2.293017,"scheduling_latency_s":2.293054,"redis_calls":10,"redis_duration_s":0.009142,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001421,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.007721,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023143,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039105,"completed_at":"2026-09-04T07:33:30.748Z","load_balancing_strategy":"primary","db_duration_s":0.002783,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2838gitlab # [ 549.011008] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:30.750Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"85a613f475154ce9b264df3e","created_at":"2026-09-04T07:33:28.368Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-98409ceaa5d64807","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9a650a748b311e70654da16e3b458efb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:28.416Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-85a613f475154ce9b264df3e: start","job_status":"start","queue_duration_s":2.334266,"scheduling_latency_s":2.334293}2839gitlab # [ 549.023440] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:30.766Z","message":"No existing merge request to be cleaned up."}2840gitlab # [ 549.025166] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:30.780Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"85a613f475154ce9b264df3e","created_at":"2026-09-04T07:33:28.368Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-98409ceaa5d64807","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9a650a748b311e70654da16e3b458efb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:28.416Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-85a613f475154ce9b264df3e: done: 0.029462 sec","job_status":"done","queue_duration_s":2.334266,"scheduling_latency_s":2.334293,"redis_calls":10,"redis_duration_s":0.0032770000000000004,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001458,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001819,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019812,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029462,"completed_at":"2026-09-04T07:33:30.780Z","load_balancing_strategy":"primary","db_duration_s":0.002645,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2841gitlab # [ 549.065379] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:30.782Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f6cb59153ef4bd83527c51b2","created_at":"2026-09-04T07:33:28.368Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-98409ceaa5d64807","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9a650a748b311e70654da16e3b458efb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:28.416Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f6cb59153ef4bd83527c51b2: start","job_status":"start","queue_duration_s":2.365875,"scheduling_latency_s":2.365902}2842gitlab # [ 549.077950] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:30.797Z","message":"No existing merge request to be cleaned up."}2843gitlab # [ 549.079625] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:30.811Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f6cb59153ef4bd83527c51b2","created_at":"2026-09-04T07:33:28.368Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-98409ceaa5d64807","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9a650a748b311e70654da16e3b458efb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:28.416Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f6cb59153ef4bd83527c51b2: done: 0.028978 sec","job_status":"done","queue_duration_s":2.365875,"scheduling_latency_s":2.365902,"redis_calls":10,"redis_duration_s":0.003479,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001363,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002116,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028978,"completed_at":"2026-09-04T07:33:30.811Z","load_balancing_strategy":"primary","db_duration_s":0.002341,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2844gitlab # [ 549.118925] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:30.813Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"fc1d3cc657f6f093b9bc192b","created_at":"2026-09-04T07:33:29.523Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-257fe4910a3045b2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"3a4aa258684f7edd193b3b427796759c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:29.558Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-fc1d3cc657f6f093b9bc192b: start","job_status":"start","queue_duration_s":1.255107,"scheduling_latency_s":1.255131}2845gitlab # [ 549.132317] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:30.854Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"fc1d3cc657f6f093b9bc192b","created_at":"2026-09-04T07:33:29.523Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-257fe4910a3045b2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"3a4aa258684f7edd193b3b427796759c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:29.558Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-fc1d3cc657f6f093b9bc192b: done: 0.041222 sec","job_status":"done","queue_duration_s":1.255107,"scheduling_latency_s":1.255131,"redis_calls":16,"redis_duration_s":0.007109,"redis_read_bytes":14,"redis_write_bytes":1526,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000596,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00154,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":423,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004973,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":802,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025834,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00067574,"duration_s":0.041222,"completed_at":"2026-09-04T07:33:30.854Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002388,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2846gitlab # [ 549.173211] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:30.857Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"9316aeb74e7ac2883b1240bc","created_at":"2026-09-04T07:33:29.523Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-257fe4910a3045b2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"3a4aa258684f7edd193b3b427796759c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:29.558Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-9316aeb74e7ac2883b1240bc: start","job_status":"start","queue_duration_s":1.298752,"scheduling_latency_s":1.298776}2847gitlab # [ 549.186430] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:30.888Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"9316aeb74e7ac2883b1240bc","created_at":"2026-09-04T07:33:29.523Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-257fe4910a3045b2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"3a4aa258684f7edd193b3b427796759c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:29.558Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-9316aeb74e7ac2883b1240bc: done: 0.031703 sec","job_status":"done","queue_duration_s":1.298752,"scheduling_latency_s":1.298776,"redis_calls":13,"redis_duration_s":0.004812,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00133,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003482,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031703,"completed_at":"2026-09-04T07:33:30.888Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00183,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2848gitlab # [ 549.226539] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:30.890Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"8b4a6bffef91b8475a4240a9","created_at":"2026-09-04T07:33:29.523Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-257fe4910a3045b2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"3a4aa258684f7edd193b3b427796759c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:29.558Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-8b4a6bffef91b8475a4240a9: start","job_status":"start","queue_duration_s":1.332324,"scheduling_latency_s":1.332351}2849gitlab # [ 549.239854] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:30.915Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"8b4a6bffef91b8475a4240a9","created_at":"2026-09-04T07:33:29.523Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-257fe4910a3045b2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"3a4aa258684f7edd193b3b427796759c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:29.558Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-8b4a6bffef91b8475a4240a9: done: 0.024707 sec","job_status":"done","queue_duration_s":1.332324,"scheduling_latency_s":1.332351,"redis_calls":13,"redis_duration_s":0.003809,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001125,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002684,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024707,"completed_at":"2026-09-04T07:33:30.915Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001497,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2850gitlab # [ 549.281301] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:30.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"a80d8d982722d490a41028ec","created_at":"2026-09-04T07:33:29.523Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-257fe4910a3045b2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"3a4aa258684f7edd193b3b427796759c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:29.558Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-a80d8d982722d490a41028ec: start","job_status":"start","queue_duration_s":1.35904,"scheduling_latency_s":1.359067}2851gitlab # [ 549.294813] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:30.943Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"a80d8d982722d490a41028ec","created_at":"2026-09-04T07:33:29.523Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-257fe4910a3045b2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"3a4aa258684f7edd193b3b427796759c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:29.558Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-a80d8d982722d490a41028ec: done: 0.025933 sec","job_status":"done","queue_duration_s":1.35904,"scheduling_latency_s":1.359067,"redis_calls":13,"redis_duration_s":0.004143,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00127,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002873,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01589,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025933,"completed_at":"2026-09-04T07:33:30.943Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001485,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2852gitlab # [ 549.335064] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:30.945Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"e49c984da6e4d7a20cc63355","created_at":"2026-09-04T07:33:29.523Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-257fe4910a3045b2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"3a4aa258684f7edd193b3b427796759c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:29.558Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-e49c984da6e4d7a20cc63355: start","job_status":"start","queue_duration_s":1.386865,"scheduling_latency_s":1.386887}2853gitlab # [ 549.348975] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:30.970Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"e49c984da6e4d7a20cc63355","created_at":"2026-09-04T07:33:29.523Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-257fe4910a3045b2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"3a4aa258684f7edd193b3b427796759c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:29.558Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-e49c984da6e4d7a20cc63355: done: 0.02554 sec","job_status":"done","queue_duration_s":1.386865,"scheduling_latency_s":1.386887,"redis_calls":13,"redis_duration_s":0.0039959999999999996,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00132,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002676,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01583,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02554,"completed_at":"2026-09-04T07:33:30.970Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001589,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2854gitlab # [ 549.389176] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:30.973Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"42c529df8c73b0360be158eb","created_at":"2026-09-04T07:33:29.523Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-257fe4910a3045b2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"3a4aa258684f7edd193b3b427796759c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:29.558Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-42c529df8c73b0360be158eb: start","job_status":"start","queue_duration_s":1.414786,"scheduling_latency_s":1.414812}2855gitlab # [ 549.402643] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:30.999Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"42c529df8c73b0360be158eb","created_at":"2026-09-04T07:33:29.523Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-257fe4910a3045b2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"3a4aa258684f7edd193b3b427796759c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:29.558Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-42c529df8c73b0360be158eb: done: 0.026305 sec","job_status":"done","queue_duration_s":1.414786,"scheduling_latency_s":1.414812,"redis_calls":13,"redis_duration_s":0.003943,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0012,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002743,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016245,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026305,"completed_at":"2026-09-04T07:33:30.999Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001399,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2856gitlab # [ 549.442520] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:31.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"406a99b3c29bd0e0eaa706de","created_at":"2026-09-04T07:33:29.523Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-257fe4910a3045b2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"3a4aa258684f7edd193b3b427796759c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:29.558Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-406a99b3c29bd0e0eaa706de: start","job_status":"start","queue_duration_s":1.443255,"scheduling_latency_s":1.443279}2857gitlab # [ 549.455651] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:31.026Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"406a99b3c29bd0e0eaa706de","created_at":"2026-09-04T07:33:29.523Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-257fe4910a3045b2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"3a4aa258684f7edd193b3b427796759c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:29.558Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-406a99b3c29bd0e0eaa706de: done: 0.0249 sec","job_status":"done","queue_duration_s":1.443255,"scheduling_latency_s":1.443279,"redis_calls":13,"redis_duration_s":0.00365,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001226,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002424,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0249,"completed_at":"2026-09-04T07:33:31.026Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000887,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2858gitlab # [ 549.496354] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:31.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"3ee8fc2ae98ccae46fe3770b","created_at":"2026-09-04T07:33:29.523Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-257fe4910a3045b2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"3a4aa258684f7edd193b3b427796759c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:29.558Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-3ee8fc2ae98ccae46fe3770b: start","job_status":"start","queue_duration_s":1.471253,"scheduling_latency_s":1.471275}2859gitlab # [ 549.510723] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:31.053Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"3ee8fc2ae98ccae46fe3770b","created_at":"2026-09-04T07:33:29.523Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-257fe4910a3045b2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"3a4aa258684f7edd193b3b427796759c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:29.558Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-3ee8fc2ae98ccae46fe3770b: done: 0.023343 sec","job_status":"done","queue_duration_s":1.471253,"scheduling_latency_s":1.471275,"redis_calls":13,"redis_duration_s":0.004477999999999999,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001241,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003237,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023343,"completed_at":"2026-09-04T07:33:31.052Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000882,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2860gitlab # [ 549.550958] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:31.054Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"5966edd8e181e0d6ac72ec65","created_at":"2026-09-04T07:33:29.523Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-257fe4910a3045b2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"3a4aa258684f7edd193b3b427796759c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:29.558Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-5966edd8e181e0d6ac72ec65: start","job_status":"start","queue_duration_s":1.49649,"scheduling_latency_s":1.496512}2861gitlab # [ 549.564663] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:31.079Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"5966edd8e181e0d6ac72ec65","created_at":"2026-09-04T07:33:29.523Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-257fe4910a3045b2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"3a4aa258684f7edd193b3b427796759c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:29.558Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-5966edd8e181e0d6ac72ec65: done: 0.024342 sec","job_status":"done","queue_duration_s":1.49649,"scheduling_latency_s":1.496512,"redis_calls":13,"redis_duration_s":0.00393,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001306,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002624,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015321,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024342,"completed_at":"2026-09-04T07:33:31.079Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000941,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2862gitlab # [ 549.604739] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:31.082Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"4eaa1cadebf36ae96e4cd2c7","created_at":"2026-09-04T07:33:29.523Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-257fe4910a3045b2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"3a4aa258684f7edd193b3b427796759c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:29.558Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-4eaa1cadebf36ae96e4cd2c7: start","job_status":"start","queue_duration_s":1.523609,"scheduling_latency_s":1.523633}2863gitlab # [ 549.618010] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:31.108Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"4eaa1cadebf36ae96e4cd2c7","created_at":"2026-09-04T07:33:29.523Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-257fe4910a3045b2","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"3a4aa258684f7edd193b3b427796759c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:33:29.558Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-4eaa1cadebf36ae96e4cd2c7: done: 0.026159 sec","job_status":"done","queue_duration_s":1.523609,"scheduling_latency_s":1.523633,"redis_calls":13,"redis_duration_s":0.005245,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001751,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003494,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016624,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026159,"completed_at":"2026-09-04T07:33:31.108Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000884,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2864gitlab # [ 549.659778] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:31.110Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"fb1943bb4623f9feb640a4bb","created_at":"2026-09-04T07:33:30.068Z","trace_propagation_headers":{"sentry-trace":"deb2600f5f4041d3bbc661226b6a29b8-42e9f2f340c742fc","baggage":"sentry-trace_id=deb2600f5f4041d3bbc661226b6a29b8,sentry-release=Unknown"},"correlation_id":"01M1NNCCMMGB46711QER17ZEB1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:30.077Z","job_size_bytes":23,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-fb1943bb4623f9feb640a4bb: start","job_status":"start","queue_duration_s":1.032672,"scheduling_latency_s":1.032701}2865gitlab # [ 549.677857] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:31.181Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"fb1943bb4623f9feb640a4bb","created_at":"2026-09-04T07:33:30.068Z","trace_propagation_headers":{"sentry-trace":"deb2600f5f4041d3bbc661226b6a29b8-42e9f2f340c742fc","baggage":"sentry-trace_id=deb2600f5f4041d3bbc661226b6a29b8,sentry-release=Unknown"},"correlation_id":"01M1NNCCMMGB46711QER17ZEB1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:30.077Z","job_size_bytes":23,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-fb1943bb4623f9feb640a4bb: done: 0.070777 sec","job_status":"done","queue_duration_s":1.032672,"scheduling_latency_s":1.032701,"redis_calls":7,"redis_duration_s":0.002595,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001846,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000749,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049462,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.070777,"completed_at":"2026-09-04T07:33:31.181Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015936,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2866gitlab # [ 549.724800] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:31.183Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"52e06e8df2b74219ca714abe","created_at":"2026-09-04T07:33:30.360Z","trace_propagation_headers":{"sentry-trace":"deb2600f5f4041d3bbc661226b6a29b8-42e9f2f340c742fc","baggage":"sentry-trace_id=deb2600f5f4041d3bbc661226b6a29b8,sentry-release=Unknown"},"correlation_id":"01M1NNCCMMGB46711QER17ZEB1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:30.386Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-52e06e8df2b74219ca714abe: start","job_status":"start","queue_duration_s":0.796773,"scheduling_latency_s":0.796801}2867gitlab # [ 549.742731] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:31.230Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"52e06e8df2b74219ca714abe","created_at":"2026-09-04T07:33:30.360Z","trace_propagation_headers":{"sentry-trace":"deb2600f5f4041d3bbc661226b6a29b8-42e9f2f340c742fc","baggage":"sentry-trace_id=deb2600f5f4041d3bbc661226b6a29b8,sentry-release=Unknown"},"correlation_id":"01M1NNCCMMGB46711QER17ZEB1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:30.386Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-52e06e8df2b74219ca714abe: done: 0.046955 sec","job_status":"done","queue_duration_s":0.796773,"scheduling_latency_s":0.796801,"redis_calls":7,"redis_duration_s":0.002532,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001903,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000629,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.046955,"completed_at":"2026-09-04T07:33:31.230Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010658,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2868gitlab # [ 549.786411] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:31.233Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"846705844cb574fbb314b3de","created_at":"2026-09-04T07:33:30.412Z","trace_propagation_headers":{"sentry-trace":"deb2600f5f4041d3bbc661226b6a29b8-42e9f2f340c742fc","baggage":"sentry-trace_id=deb2600f5f4041d3bbc661226b6a29b8,sentry-release=Unknown"},"correlation_id":"01M1NNCCMMGB46711QER17ZEB1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:30.421Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-846705844cb574fbb314b3de: start","job_status":"start","queue_duration_s":0.81161,"scheduling_latency_s":0.811637}2869gitlab # [ 549.803701] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:31.542Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"846705844cb574fbb314b3de","created_at":"2026-09-04T07:33:30.412Z","trace_propagation_headers":{"sentry-trace":"deb2600f5f4041d3bbc661226b6a29b8-42e9f2f340c742fc","baggage":"sentry-trace_id=deb2600f5f4041d3bbc661226b6a29b8,sentry-release=Unknown"},"correlation_id":"01M1NNCCMMGB46711QER17ZEB1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:30.421Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-846705844cb574fbb314b3de: done: 0.309074 sec","job_status":"done","queue_duration_s":0.81161,"scheduling_latency_s":0.811637,"redis_calls":7,"redis_duration_s":0.003483,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002524,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000959,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.244,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.244,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057802,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.309074,"completed_at":"2026-09-04T07:33:31.541Z","load_balancing_strategy":"primary","db_duration_s":0.243719,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2870gitlab # [ 549.848835] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:31.547Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"8a429b0c3f162a60f66e6837","created_at":"2026-09-04T07:33:30.451Z","trace_propagation_headers":{"sentry-trace":"deb2600f5f4041d3bbc661226b6a29b8-42e9f2f340c742fc","baggage":"sentry-trace_id=deb2600f5f4041d3bbc661226b6a29b8,sentry-release=Unknown"},"correlation_id":"01M1NNCCMMGB46711QER17ZEB1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:30.457Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-8a429b0c3f162a60f66e6837: start","job_status":"start","queue_duration_s":1.090203,"scheduling_latency_s":1.090276}2871gitlab # [ 549.865588] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:31.663Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"8a429b0c3f162a60f66e6837","created_at":"2026-09-04T07:33:30.451Z","trace_propagation_headers":{"sentry-trace":"deb2600f5f4041d3bbc661226b6a29b8-42e9f2f340c742fc","baggage":"sentry-trace_id=deb2600f5f4041d3bbc661226b6a29b8,sentry-release=Unknown"},"correlation_id":"01M1NNCCMMGB46711QER17ZEB1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:30.457Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-8a429b0c3f162a60f66e6837: done: 0.115641 sec","job_status":"done","queue_duration_s":1.090203,"scheduling_latency_s":1.090276,"redis_calls":10,"redis_duration_s":0.008432,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003003,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.0042,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001229,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.080423,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.115641,"completed_at":"2026-09-04T07:33:31.663Z","load_balancing_strategy":"primary","db_duration_s":0.014265,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2872gitlab # [ 549.913065] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:31.667Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"d2e19f5ff46a1ffeeb7f1aaf","created_at":"2026-09-04T07:33:30.459Z","trace_propagation_headers":{"sentry-trace":"deb2600f5f4041d3bbc661226b6a29b8-42e9f2f340c742fc","baggage":"sentry-trace_id=deb2600f5f4041d3bbc661226b6a29b8,sentry-release=Unknown"},"correlation_id":"01M1NNCCMMGB46711QER17ZEB1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:30.465Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-d2e19f5ff46a1ffeeb7f1aaf: start","job_status":"start","queue_duration_s":1.201974,"scheduling_latency_s":1.202023}2873gitlab # [ 549.929794] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:31.744Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"d2e19f5ff46a1ffeeb7f1aaf","created_at":"2026-09-04T07:33:30.459Z","trace_propagation_headers":{"sentry-trace":"deb2600f5f4041d3bbc661226b6a29b8-42e9f2f340c742fc","baggage":"sentry-trace_id=deb2600f5f4041d3bbc661226b6a29b8,sentry-release=Unknown"},"correlation_id":"01M1NNCCMMGB46711QER17ZEB1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:30.465Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-d2e19f5ff46a1ffeeb7f1aaf: done: 0.077589 sec","job_status":"done","queue_duration_s":1.201974,"scheduling_latency_s":1.202023,"redis_calls":7,"redis_duration_s":0.0040950000000000005,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003161,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054922,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.077589,"completed_at":"2026-09-04T07:33:31.744Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011665,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2874gitlab # [ 549.972840] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:31.748Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"478bd4bce9367f8f548dca3d","created_at":"2026-09-04T07:33:30.468Z","trace_propagation_headers":{"sentry-trace":"deb2600f5f4041d3bbc661226b6a29b8-42e9f2f340c742fc","baggage":"sentry-trace_id=deb2600f5f4041d3bbc661226b6a29b8,sentry-release=Unknown"},"correlation_id":"01M1NNCCMMGB46711QER17ZEB1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:30.476Z","job_size_bytes":19,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-478bd4bce9367f8f548dca3d: start","job_status":"start","queue_duration_s":1.271865,"scheduling_latency_s":1.271915}2875gitlab # [ 549.989244] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:31.815Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"478bd4bce9367f8f548dca3d","created_at":"2026-09-04T07:33:30.468Z","trace_propagation_headers":{"sentry-trace":"deb2600f5f4041d3bbc661226b6a29b8-42e9f2f340c742fc","baggage":"sentry-trace_id=deb2600f5f4041d3bbc661226b6a29b8,sentry-release=Unknown"},"correlation_id":"01M1NNCCMMGB46711QER17ZEB1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:30.476Z","job_size_bytes":19,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-478bd4bce9367f8f548dca3d: done: 0.066704 sec","job_status":"done","queue_duration_s":1.271865,"scheduling_latency_s":1.271915,"redis_calls":8,"redis_duration_s":0.004195,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003389,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000806,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.066704,"completed_at":"2026-09-04T07:33:31.815Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00786,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2876gitlab # [ 550.032134] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:31.818Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"189d9b8c6d755e01dd2a0ed2","created_at":"2026-09-04T07:33:30.479Z","trace_propagation_headers":{"sentry-trace":"deb2600f5f4041d3bbc661226b6a29b8-42e9f2f340c742fc","baggage":"sentry-trace_id=deb2600f5f4041d3bbc661226b6a29b8,sentry-release=Unknown"},"correlation_id":"01M1NNCCMMGB46711QER17ZEB1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:30.483Z","job_size_bytes":66,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-189d9b8c6d755e01dd2a0ed2: start","job_status":"start","queue_duration_s":1.334346,"scheduling_latency_s":1.334409}2877gitlab # [ 550.049639] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:31.874Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"189d9b8c6d755e01dd2a0ed2","created_at":"2026-09-04T07:33:30.479Z","trace_propagation_headers":{"sentry-trace":"deb2600f5f4041d3bbc661226b6a29b8-42e9f2f340c742fc","baggage":"sentry-trace_id=deb2600f5f4041d3bbc661226b6a29b8,sentry-release=Unknown"},"correlation_id":"01M1NNCCMMGB46711QER17ZEB1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:30.483Z","job_size_bytes":66,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-189d9b8c6d755e01dd2a0ed2: done: 0.056439 sec","job_status":"done","queue_duration_s":1.334346,"scheduling_latency_s":1.334409,"redis_calls":7,"redis_duration_s":0.0036769999999999997,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002169,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001508,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037177,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.056439,"completed_at":"2026-09-04T07:33:31.874Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008987,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2878gitlab # [ 550.094442] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:31.877Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"e0dc8b511c2b4ae3717755a0","created_at":"2026-09-04T07:33:30.485Z","trace_propagation_headers":{"sentry-trace":"deb2600f5f4041d3bbc661226b6a29b8-42e9f2f340c742fc","baggage":"sentry-trace_id=deb2600f5f4041d3bbc661226b6a29b8,sentry-release=Unknown"},"correlation_id":"01M1NNCCMMGB46711QER17ZEB1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:30.490Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-e0dc8b511c2b4ae3717755a0: start","job_status":"start","queue_duration_s":1.387178,"scheduling_latency_s":1.387214}2879gitlab # [ 550.111904] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:31.974Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"e0dc8b511c2b4ae3717755a0","created_at":"2026-09-04T07:33:30.485Z","trace_propagation_headers":{"sentry-trace":"deb2600f5f4041d3bbc661226b6a29b8-42e9f2f340c742fc","baggage":"sentry-trace_id=deb2600f5f4041d3bbc661226b6a29b8,sentry-release=Unknown"},"correlation_id":"01M1NNCCMMGB46711QER17ZEB1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:30.490Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-e0dc8b511c2b4ae3717755a0: done: 0.097185 sec","job_status":"done","queue_duration_s":1.387178,"scheduling_latency_s":1.387214,"redis_calls":7,"redis_duration_s":0.004566000000000001,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003589,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000977,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.070706,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.097185,"completed_at":"2026-09-04T07:33:31.974Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013773,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2880gitlab # [ 550.154885] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:31.981Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"47ab8ca4a81796ba09e314b9","created_at":"2026-09-04T07:33:30.504Z","trace_propagation_headers":{"sentry-trace":"deb2600f5f4041d3bbc661226b6a29b8-42e9f2f340c742fc","baggage":"sentry-trace_id=deb2600f5f4041d3bbc661226b6a29b8,sentry-release=Unknown"},"correlation_id":"01M1NNCCMMGB46711QER17ZEB1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:30.508Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-47ab8ca4a81796ba09e314b9: start","job_status":"start","queue_duration_s":1.472517,"scheduling_latency_s":1.47258}2881gitlab # [ 550.190609] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:32.075Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"47ab8ca4a81796ba09e314b9","created_at":"2026-09-04T07:33:30.504Z","trace_propagation_headers":{"sentry-trace":"deb2600f5f4041d3bbc661226b6a29b8-42e9f2f340c742fc","baggage":"sentry-trace_id=deb2600f5f4041d3bbc661226b6a29b8,sentry-release=Unknown"},"correlation_id":"01M1NNCCMMGB46711QER17ZEB1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:30.508Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-47ab8ca4a81796ba09e314b9: done: 0.094032 sec","job_status":"done","queue_duration_s":1.472517,"scheduling_latency_s":1.47258,"redis_calls":7,"redis_duration_s":0.003959000000000001,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002903,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001056,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.094032,"completed_at":"2026-09-04T07:33:32.075Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013525,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2882gitlab # [ 550.235385] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:32.080Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"621ff5ad9ec837cac32cb7f3","created_at":"2026-09-04T07:33:30.509Z","trace_propagation_headers":{"sentry-trace":"deb2600f5f4041d3bbc661226b6a29b8-42e9f2f340c742fc","baggage":"sentry-trace_id=deb2600f5f4041d3bbc661226b6a29b8,sentry-release=Unknown"},"correlation_id":"01M1NNCCMMGB46711QER17ZEB1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:30.514Z","job_size_bytes":6,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-621ff5ad9ec837cac32cb7f3: start","job_status":"start","queue_duration_s":1.56647,"scheduling_latency_s":1.566528}2883gitlab # [ 550.253224] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:32.138Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"621ff5ad9ec837cac32cb7f3","created_at":"2026-09-04T07:33:30.509Z","trace_propagation_headers":{"sentry-trace":"deb2600f5f4041d3bbc661226b6a29b8-42e9f2f340c742fc","baggage":"sentry-trace_id=deb2600f5f4041d3bbc661226b6a29b8,sentry-release=Unknown"},"correlation_id":"01M1NNCCMMGB46711QER17ZEB1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:30.514Z","job_size_bytes":6,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-621ff5ad9ec837cac32cb7f3: done: 0.057984 sec","job_status":"done","queue_duration_s":1.56647,"scheduling_latency_s":1.566528,"redis_calls":7,"redis_duration_s":0.005133,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003724,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001409,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036311,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.057984,"completed_at":"2026-09-04T07:33:32.138Z","load_balancing_strategy":"primary","db_duration_s":0.002275,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2884gitlab # [ 550.300182] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:32.141Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"d434ad34115d081391fe59aa","created_at":"2026-09-04T07:33:30.515Z","trace_propagation_headers":{"sentry-trace":"deb2600f5f4041d3bbc661226b6a29b8-42e9f2f340c742fc","baggage":"sentry-trace_id=deb2600f5f4041d3bbc661226b6a29b8,sentry-release=Unknown"},"correlation_id":"01M1NNCCMMGB46711QER17ZEB1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:30.519Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-d434ad34115d081391fe59aa: start","job_status":"start","queue_duration_s":1.622807,"scheduling_latency_s":1.622848}2885gitlab # [ 550.325830] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:32.211Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"d434ad34115d081391fe59aa","created_at":"2026-09-04T07:33:30.515Z","trace_propagation_headers":{"sentry-trace":"deb2600f5f4041d3bbc661226b6a29b8-42e9f2f340c742fc","baggage":"sentry-trace_id=deb2600f5f4041d3bbc661226b6a29b8,sentry-release=Unknown"},"correlation_id":"01M1NNCCMMGB46711QER17ZEB1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:30.519Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-d434ad34115d081391fe59aa: done: 0.069282 sec","job_status":"done","queue_duration_s":1.622807,"scheduling_latency_s":1.622848,"redis_calls":7,"redis_duration_s":0.0038780000000000004,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002817,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001061,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.069282,"completed_at":"2026-09-04T07:33:32.210Z","load_balancing_strategy":"primary","db_duration_s":0.010607,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2886gitlab # [ 550.369721] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:32.214Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"e4ffec680280378de074e114","created_at":"2026-09-04T07:33:30.636Z","trace_propagation_headers":{"sentry-trace":"deb2600f5f4041d3bbc661226b6a29b8-42e9f2f340c742fc","baggage":"sentry-trace_id=deb2600f5f4041d3bbc661226b6a29b8,sentry-release=Unknown"},"correlation_id":"01M1NNCCMMGB46711QER17ZEB1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:30.640Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e4ffec680280378de074e114: start","job_status":"start","queue_duration_s":1.574745,"scheduling_latency_s":1.574792}2887gitlab # [ 550.417337] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:33:32.301Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"e4ffec680280378de074e114","created_at":"2026-09-04T07:33:30.636Z","trace_propagation_headers":{"sentry-trace":"deb2600f5f4041d3bbc661226b6a29b8-42e9f2f340c742fc","baggage":"sentry-trace_id=deb2600f5f4041d3bbc661226b6a29b8,sentry-release=Unknown"},"correlation_id":"01M1NNCCMMGB46711QER17ZEB1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T07:33:30.640Z","job_size_bytes":3,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e4ffec680280378de074e114: done: 0.086834 sec","job_status":"done","queue_duration_s":1.574745,"scheduling_latency_s":1.574792,"redis_calls":8,"redis_duration_s":0.004512,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00371,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000802,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.064524,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.086834,"completed_at":"2026-09-04T07:33:32.301Z","load_balancing_strategy":"primary","db_duration_s":0.009884,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2888gitlab # W, [2026-09-04T07:33:51.453268 #4623] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.2889gitlab # 2890gitlab # [ 579.435725] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:01.319Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"85bbab0c3df1a3431f5ec09b","created_at":"2026-09-04T07:34:01.267Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.314Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-85bbab0c3df1a3431f5ec09b: start","job_status":"start","queue_duration_s":0.004151,"scheduling_latency_s":0.004226}2891gitlab # [ 580.133564] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:02.018Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"85bbab0c3df1a3431f5ec09b","created_at":"2026-09-04T07:34:01.267Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.314Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-85bbab0c3df1a3431f5ec09b: done: 0.699429 sec","job_status":"done","queue_duration_s":0.004151,"scheduling_latency_s":0.004226,"redis_calls":60,"redis_duration_s":0.198434,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.002877,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.190051,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.005506,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.293856,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.699429,"completed_at":"2026-09-04T07:34:02.018Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2892gitlab # [ 580.225644] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:02.029Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"ec906a84819e17222e04fb87","created_at":"2026-09-04T07:34:01.367Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4957bbb8216304becadf7ce90795cdad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:34:01.397Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-ec906a84819e17222e04fb87: start","job_status":"start","queue_duration_s":0.632345,"scheduling_latency_s":0.632414}2893gitlab # [ 580.225853] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:02.061Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}2894gitlab # [ 580.225946] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:02.077Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"ec906a84819e17222e04fb87","created_at":"2026-09-04T07:34:01.367Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4957bbb8216304becadf7ce90795cdad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:34:01.397Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-ec906a84819e17222e04fb87: done: 0.048373 sec","job_status":"done","queue_duration_s":0.632345,"scheduling_latency_s":0.632414,"redis_calls":7,"redis_duration_s":0.003458,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00247,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000988,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027521,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048373,"completed_at":"2026-09-04T07:34:02.077Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2895gitlab # [ 580.911593] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:02.081Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"92d88ab602f8677f7d52a3a3","created_at":"2026-09-04T07:34:01.423Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4cce9a10a89c9ef6ab1fd7874b1681bd","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.441Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-92d88ab602f8677f7d52a3a3: start","job_status":"start","queue_duration_s":0.639703,"scheduling_latency_s":0.639754}2896gitlab # [ 580.911737] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:02.232Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"92d88ab602f8677f7d52a3a3","created_at":"2026-09-04T07:34:01.423Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4cce9a10a89c9ef6ab1fd7874b1681bd","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.441Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-92d88ab602f8677f7d52a3a3: done: 0.151878 sec","job_status":"done","queue_duration_s":0.639703,"scheduling_latency_s":0.639754,"redis_calls":11,"redis_duration_s":0.007936,"redis_read_bytes":136,"redis_write_bytes":1288,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000327,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":49,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006048,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001561,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.085,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.085,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0917603,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.151878,"completed_at":"2026-09-04T07:34:02.232Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.110234,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2897gitlab # [ 581.615388] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:02.261Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"b470aac1a8eb2234023504d3","created_at":"2026-09-04T07:34:01.476Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5e2cc28095f55193bad594ea5426edc6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.489Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-b470aac1a8eb2234023504d3: start","job_status":"start","queue_duration_s":0.771266,"scheduling_latency_s":0.771334}2898gitlab # [ 581.615553] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:02.477Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"b470aac1a8eb2234023504d3","created_at":"2026-09-04T07:34:01.476Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5e2cc28095f55193bad594ea5426edc6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.489Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-b470aac1a8eb2234023504d3: done: 0.21654 sec","job_status":"done","queue_duration_s":0.771266,"scheduling_latency_s":0.771334,"redis_calls":9,"redis_duration_s":0.011695,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004565,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00713,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.075,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.075,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.059237,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00524222,"exclusive_lock_hold_duration_s":0.1115563,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.21654,"completed_at":"2026-09-04T07:34:02.477Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.086841,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2899gitlab # [ 582.287658] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:02.480Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"4ab35a6cd8b314f94400e927","created_at":"2026-09-04T07:34:01.526Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9d270f608c0b9c1120ac1750f2de1401","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.538Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-4ab35a6cd8b314f94400e927: start","job_status":"start","queue_duration_s":0.941947,"scheduling_latency_s":0.941987}2900gitlab # [ 582.960956] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:02.512Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"4ab35a6cd8b314f94400e927","created_at":"2026-09-04T07:34:01.526Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9d270f608c0b9c1120ac1750f2de1401","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.538Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-4ab35a6cd8b314f94400e927: done: 0.031467 sec","job_status":"done","queue_duration_s":0.941947,"scheduling_latency_s":0.941987,"redis_calls":7,"redis_duration_s":0.002781,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002032,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000749,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031467,"completed_at":"2026-09-04T07:34:02.512Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002549,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2901gitlab # [ 583.619880] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:02.515Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"e7f1d20ce0b3bc671e473aa3","created_at":"2026-09-04T07:34:01.587Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2dfd20529ad3596ba4246e55a9320f39","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.600Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-e7f1d20ce0b3bc671e473aa3: start","job_status":"start","queue_duration_s":0.914835,"scheduling_latency_s":0.914909}2902gitlab # [ 583.620649] postgres[858]: [858] LOG: checkpoint complete: wrote 8841 buffers (54.0%), wrote 3 SLRU buffers; 0 WAL file(s) added, 0 removed, 6 recycled; write=269.227 s, sync=1.068 s, total=270.318 s; sync files=12325, longest=0.003 s, average=0.001 s; distance=102579 kB, estimate=102579 kB; lsn=0/7CEF440, redo lsn=0/7B90CE02903gitlab # [ 583.620856] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:02.564Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"e7f1d20ce0b3bc671e473aa3","created_at":"2026-09-04T07:34:01.587Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2dfd20529ad3596ba4246e55a9320f39","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.600Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-e7f1d20ce0b3bc671e473aa3: done: 0.048847 sec","job_status":"done","queue_duration_s":0.914835,"scheduling_latency_s":0.914909,"redis_calls":8,"redis_duration_s":0.0048590000000000005,"redis_read_bytes":133,"redis_write_bytes":901,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000469,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003294,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001096,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031925,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048847,"completed_at":"2026-09-04T07:34:02.564Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2904gitlab # [ 584.295349] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:02.568Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"97f9afc4c75ca6607dbbfa8e","created_at":"2026-09-04T07:34:01.638Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a1e208aeba8134c1dedac81f97b02cbc","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.649Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-97f9afc4c75ca6607dbbfa8e: start","job_status":"start","queue_duration_s":0.91853,"scheduling_latency_s":0.918587}2905gitlab # [ 584.295681] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:02.632Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"97f9afc4c75ca6607dbbfa8e","created_at":"2026-09-04T07:34:01.638Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a1e208aeba8134c1dedac81f97b02cbc","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.649Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-97f9afc4c75ca6607dbbfa8e: done: 0.064274 sec","job_status":"done","queue_duration_s":0.91853,"scheduling_latency_s":0.918587,"redis_calls":7,"redis_duration_s":0.003213,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002243,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00097,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.064274,"completed_at":"2026-09-04T07:34:02.632Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020813,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2906gitlab # [ 585.032378] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:02.636Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"209df7e84b22342a50ba1268","created_at":"2026-09-04T07:34:01.667Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"41996bf8cae762fe52f4f5db4caecc9c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.678Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-209df7e84b22342a50ba1268: start","job_status":"start","queue_duration_s":0.958177,"scheduling_latency_s":0.958231}2907gitlab # [ 585.032554] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:02.655Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}2908gitlab # [ 585.032754] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:02.665Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"209df7e84b22342a50ba1268","created_at":"2026-09-04T07:34:01.667Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"41996bf8cae762fe52f4f5db4caecc9c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.678Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-209df7e84b22342a50ba1268: done: 0.029328 sec","job_status":"done","queue_duration_s":0.958177,"scheduling_latency_s":0.958231,"redis_calls":7,"redis_duration_s":0.00248,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001797,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000683,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029328,"completed_at":"2026-09-04T07:34:02.665Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2909gitlab # [ 585.736280] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:02.668Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"ae45769e2781968afb3ad82a","created_at":"2026-09-04T07:34:01.697Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d710acf28556b6804c39e5511b5e2b9a","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.720Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-ae45769e2781968afb3ad82a: start","job_status":"start","queue_duration_s":0.947081,"scheduling_latency_s":0.947114}2910gitlab # [ 586.468538] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:02.724Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"ae45769e2781968afb3ad82a","created_at":"2026-09-04T07:34:01.697Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d710acf28556b6804c39e5511b5e2b9a","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.720Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-ae45769e2781968afb3ad82a: done: 0.056173 sec","job_status":"done","queue_duration_s":0.947081,"scheduling_latency_s":0.947114,"redis_calls":9,"redis_duration_s":0.0032649999999999997,"redis_read_bytes":7,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000597,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001916,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000752,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032125,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.056173,"completed_at":"2026-09-04T07:34:02.724Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012242,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2911gitlab # [ 587.174019] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:02.727Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"5a4afe17be0453fc36677131","created_at":"2026-09-04T07:34:01.764Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f4f0982a5d91a3846fa50612cc7690e5","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.773Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-5a4afe17be0453fc36677131: start","job_status":"start","queue_duration_s":0.95393,"scheduling_latency_s":0.953974}2912gitlab # [ 587.174316] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:02.790Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"5a4afe17be0453fc36677131","created_at":"2026-09-04T07:34:01.764Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f4f0982a5d91a3846fa50612cc7690e5","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.773Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-5a4afe17be0453fc36677131: done: 0.063166 sec","job_status":"done","queue_duration_s":0.95393,"scheduling_latency_s":0.953974,"redis_calls":7,"redis_duration_s":0.0046619999999999995,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003293,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001369,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030574,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.063166,"completed_at":"2026-09-04T07:34:02.790Z","load_balancing_strategy":"primary","db_duration_s":0.017591,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2913gitlab # [ 587.912934] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:02.794Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"087aadda2297a6375bdaf584","created_at":"2026-09-04T07:34:01.800Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"29671dde25f7e86473c315960e39c3a7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.814Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-087aadda2297a6375bdaf584: start","job_status":"start","queue_duration_s":0.980157,"scheduling_latency_s":0.980207}2914gitlab # [ 587.913189] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.218Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"087aadda2297a6375bdaf584","created_at":"2026-09-04T07:34:01.800Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"29671dde25f7e86473c315960e39c3a7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.814Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-087aadda2297a6375bdaf584: done: 0.424437 sec","job_status":"done","queue_duration_s":0.980157,"scheduling_latency_s":0.980207,"redis_calls":11,"redis_duration_s":0.004763,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000937,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002016,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00181,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.072,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.072,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.332471,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001231,"exclusive_lock_hold_duration_s":0.38309744,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.424437,"completed_at":"2026-09-04T07:34:03.218Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.110546,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2915gitlab # [ 588.639205] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.221Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"400e335289bef0d31dda6922","created_at":"2026-09-04T07:34:01.858Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5ad93ec752b6321ceb0c9888607a0310","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.871Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-400e335289bef0d31dda6922: start","job_status":"start","queue_duration_s":1.349492,"scheduling_latency_s":1.349531}2916gitlab # [ 588.639493] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.313Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"400e335289bef0d31dda6922","created_at":"2026-09-04T07:34:01.858Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5ad93ec752b6321ceb0c9888607a0310","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.871Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-400e335289bef0d31dda6922: done: 0.092204 sec","job_status":"done","queue_duration_s":1.349492,"scheduling_latency_s":1.349531,"redis_calls":9,"redis_duration_s":0.003369,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001746,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001623,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018816,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00093204,"exclusive_lock_hold_duration_s":0.00610882,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.092204,"completed_at":"2026-09-04T07:34:03.313Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002539,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2917gitlab # [ 589.368211] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.315Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"bf72425e50e2558e63f456d4","created_at":"2026-09-04T07:34:01.902Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c10e15abea4949ef857eeb27d8550b64","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.916Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-bf72425e50e2558e63f456d4: start","job_status":"start","queue_duration_s":1.399287,"scheduling_latency_s":1.399317}2918gitlab # [ 590.095365] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.335Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"bf72425e50e2558e63f456d4","created_at":"2026-09-04T07:34:01.902Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c10e15abea4949ef857eeb27d8550b64","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.916Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-bf72425e50e2558e63f456d4: done: 0.019747 sec","job_status":"done","queue_duration_s":1.399287,"scheduling_latency_s":1.399317,"redis_calls":7,"redis_duration_s":0.002198,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001612,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000586,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012177,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019747,"completed_at":"2026-09-04T07:34:03.335Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2919gitlab # [ 590.820270] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd64fa65d1544f84ceafd0e6","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd64fa65d1544f84ceafd0e6: start","job_status":"start","queue_duration_s":1.373897,"scheduling_latency_s":1.373925}2920gitlab # [ 590.820513] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.360Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd64fa65d1544f84ceafd0e6","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd64fa65d1544f84ceafd0e6: done: 0.022814 sec","job_status":"done","queue_duration_s":1.373897,"scheduling_latency_s":1.373925,"redis_calls":13,"redis_duration_s":0.003606,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001139,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002467,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022814,"completed_at":"2026-09-04T07:34:03.360Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2921gitlab # [ 591.545110] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.362Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ea3b6c4b0be84c078c2b4e1","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ea3b6c4b0be84c078c2b4e1: start","job_status":"start","queue_duration_s":1.398539,"scheduling_latency_s":1.398567}2922gitlab # [ 591.545487] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.383Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ea3b6c4b0be84c078c2b4e1","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ea3b6c4b0be84c078c2b4e1: done: 0.021295 sec","job_status":"done","queue_duration_s":1.398539,"scheduling_latency_s":1.398567,"redis_calls":13,"redis_duration_s":0.003637,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001177,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00246,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01224,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021295,"completed_at":"2026-09-04T07:34:03.383Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2923gitlab # [ 592.253233] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.386Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0dd36ae681e4d165130da67f","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0dd36ae681e4d165130da67f: start","job_status":"start","queue_duration_s":1.422745,"scheduling_latency_s":1.422774}2924gitlab # [ 592.325345] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0dd36ae681e4d165130da67f","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0dd36ae681e4d165130da67f: done: 0.022139 sec","job_status":"done","queue_duration_s":1.422745,"scheduling_latency_s":1.422774,"redis_calls":13,"redis_duration_s":0.0036100000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001266,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002344,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022139,"completed_at":"2026-09-04T07:34:03.408Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2925gitlab # [ 592.387235] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.410Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3797cb9e8ad3e237abb54f43","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3797cb9e8ad3e237abb54f43: start","job_status":"start","queue_duration_s":1.446919,"scheduling_latency_s":1.446951}2926gitlab # [ 592.406634] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3797cb9e8ad3e237abb54f43","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3797cb9e8ad3e237abb54f43: done: 0.028772 sec","job_status":"done","queue_duration_s":1.446919,"scheduling_latency_s":1.446951,"redis_calls":13,"redis_duration_s":0.003602,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002038,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015522,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028772,"completed_at":"2026-09-04T07:34:03.439Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2927gitlab # [ 592.455271] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.442Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9555573fde812a9494e6dd3a","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9555573fde812a9494e6dd3a: start","job_status":"start","queue_duration_s":1.478284,"scheduling_latency_s":1.478323}2928gitlab # [ 592.468129] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9555573fde812a9494e6dd3a","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9555573fde812a9494e6dd3a: done: 0.027118 sec","job_status":"done","queue_duration_s":1.478284,"scheduling_latency_s":1.478323,"redis_calls":13,"redis_duration_s":0.003242,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001339,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018549,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027118,"completed_at":"2026-09-04T07:34:03.468Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2929gitlab # [ 592.506740] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.471Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1ea4788c8eac69fb8c813b6","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1ea4788c8eac69fb8c813b6: start","job_status":"start","queue_duration_s":1.507327,"scheduling_latency_s":1.50736}2930gitlab # [ 592.519053] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1ea4788c8eac69fb8c813b6","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1ea4788c8eac69fb8c813b6: done: 0.027172 sec","job_status":"done","queue_duration_s":1.507327,"scheduling_latency_s":1.50736,"redis_calls":13,"redis_duration_s":0.0028079999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001046,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001762,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016769,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027172,"completed_at":"2026-09-04T07:34:03.498Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2931gitlab # [ 592.557815] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.500Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb823cb5786c75fecfe2382e","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb823cb5786c75fecfe2382e: start","job_status":"start","queue_duration_s":1.536592,"scheduling_latency_s":1.536629}2932gitlab # [ 592.571291] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb823cb5786c75fecfe2382e","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb823cb5786c75fecfe2382e: done: 0.028613 sec","job_status":"done","queue_duration_s":1.536592,"scheduling_latency_s":1.536629,"redis_calls":13,"redis_duration_s":0.0029059999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001042,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001864,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019724,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028613,"completed_at":"2026-09-04T07:34:03.528Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2933gitlab # [ 592.610588] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.531Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f68fcdbf73d7ed5870a9fdb2","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f68fcdbf73d7ed5870a9fdb2: start","job_status":"start","queue_duration_s":1.567276,"scheduling_latency_s":1.56731}2934gitlab # [ 592.622664] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f68fcdbf73d7ed5870a9fdb2","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f68fcdbf73d7ed5870a9fdb2: done: 0.027067 sec","job_status":"done","queue_duration_s":1.567276,"scheduling_latency_s":1.56731,"redis_calls":13,"redis_duration_s":0.0035559999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001218,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002338,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017939,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027067,"completed_at":"2026-09-04T07:34:03.557Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2935gitlab # [ 592.661501] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.560Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c2b56b0b3e887354df1413f","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c2b56b0b3e887354df1413f: start","job_status":"start","queue_duration_s":1.59658,"scheduling_latency_s":1.596617}2936gitlab # [ 592.674047] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c2b56b0b3e887354df1413f","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c2b56b0b3e887354df1413f: done: 0.02303 sec","job_status":"done","queue_duration_s":1.59658,"scheduling_latency_s":1.596617,"redis_calls":13,"redis_duration_s":0.0031999999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001122,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002078,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014411,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02303,"completed_at":"2026-09-04T07:34:03.583Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2937gitlab # [ 592.713174] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.585Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9cc0584f73f8a7392224e12","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9cc0584f73f8a7392224e12: start","job_status":"start","queue_duration_s":1.622101,"scheduling_latency_s":1.62214}2938gitlab # [ 592.725481] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.604Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9cc0584f73f8a7392224e12","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9cc0584f73f8a7392224e12: done: 0.019673 sec","job_status":"done","queue_duration_s":1.622101,"scheduling_latency_s":1.62214,"redis_calls":13,"redis_duration_s":0.001991,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000713,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001278,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019673,"completed_at":"2026-09-04T07:34:03.604Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2939gitlab # [ 592.764287] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a5b7d1e73b0ad96ce27c528","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a5b7d1e73b0ad96ce27c528: start","job_status":"start","queue_duration_s":1.642379,"scheduling_latency_s":1.642408}2940gitlab # [ 592.777727] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.625Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a5b7d1e73b0ad96ce27c528","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a5b7d1e73b0ad96ce27c528: done: 0.019549 sec","job_status":"done","queue_duration_s":1.642379,"scheduling_latency_s":1.642408,"redis_calls":13,"redis_duration_s":0.002169,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000756,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001413,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01326,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019549,"completed_at":"2026-09-04T07:34:03.625Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2941gitlab # [ 592.816916] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.627Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e91e90fd8d9549ae0521f28","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e91e90fd8d9549ae0521f28: start","job_status":"start","queue_duration_s":1.663556,"scheduling_latency_s":1.663587}2942gitlab # [ 592.829216] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.649Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e91e90fd8d9549ae0521f28","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e91e90fd8d9549ae0521f28: done: 0.022236 sec","job_status":"done","queue_duration_s":1.663556,"scheduling_latency_s":1.663587,"redis_calls":13,"redis_duration_s":0.003211,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001192,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013382,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022236,"completed_at":"2026-09-04T07:34:03.649Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2943gitlab # [ 592.869926] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.653Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fbc5b89d22f48e585d243be6","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fbc5b89d22f48e585d243be6: start","job_status":"start","queue_duration_s":1.689234,"scheduling_latency_s":1.689268}2944gitlab # [ 592.883910] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.674Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fbc5b89d22f48e585d243be6","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fbc5b89d22f48e585d243be6: done: 0.022076 sec","job_status":"done","queue_duration_s":1.689234,"scheduling_latency_s":1.689268,"redis_calls":13,"redis_duration_s":0.003311,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001183,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002128,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022076,"completed_at":"2026-09-04T07:34:03.674Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2945gitlab # [ 592.926042] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.677Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7b97e5d4c1959c2c63e6301","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7b97e5d4c1959c2c63e6301: start","job_status":"start","queue_duration_s":1.713255,"scheduling_latency_s":1.713287}2946gitlab # [ 592.940221] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.700Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7b97e5d4c1959c2c63e6301","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7b97e5d4c1959c2c63e6301: done: 0.023722 sec","job_status":"done","queue_duration_s":1.713255,"scheduling_latency_s":1.713287,"redis_calls":13,"redis_duration_s":0.0033230000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001146,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002177,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013648,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023722,"completed_at":"2026-09-04T07:34:03.700Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2947gitlab # [ 592.984556] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ccdf2a5926a1ce8454ce87ea","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ccdf2a5926a1ce8454ce87ea: start","job_status":"start","queue_duration_s":1.738964,"scheduling_latency_s":1.738995}2948gitlab # [ 592.997957] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.723Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ccdf2a5926a1ce8454ce87ea","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ccdf2a5926a1ce8454ce87ea: done: 0.021264 sec","job_status":"done","queue_duration_s":1.738964,"scheduling_latency_s":1.738995,"redis_calls":13,"redis_duration_s":0.003224,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00112,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013455,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021264,"completed_at":"2026-09-04T07:34:03.723Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2949gitlab # [ 593.036715] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.725Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d29febdebd63fdf6d06650d","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d29febdebd63fdf6d06650d: start","job_status":"start","queue_duration_s":1.762054,"scheduling_latency_s":1.762085}2950gitlab # [ 593.048632] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.748Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d29febdebd63fdf6d06650d","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d29febdebd63fdf6d06650d: done: 0.022313 sec","job_status":"done","queue_duration_s":1.762054,"scheduling_latency_s":1.762085,"redis_calls":13,"redis_duration_s":0.003822,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00112,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002702,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014115,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022313,"completed_at":"2026-09-04T07:34:03.747Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2951gitlab # [ 593.086823] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.751Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de094d17921515c6cce23b46","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de094d17921515c6cce23b46: start","job_status":"start","queue_duration_s":1.787672,"scheduling_latency_s":1.787709}2952gitlab # [ 593.099105] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.772Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de094d17921515c6cce23b46","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de094d17921515c6cce23b46: done: 0.021583 sec","job_status":"done","queue_duration_s":1.787672,"scheduling_latency_s":1.787709,"redis_calls":13,"redis_duration_s":0.0032170000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001074,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002143,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013226,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021583,"completed_at":"2026-09-04T07:34:03.772Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2953gitlab # [ 593.137741] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.774Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c1977980c94638895291641","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c1977980c94638895291641: start","job_status":"start","queue_duration_s":1.811217,"scheduling_latency_s":1.811248}2954gitlab # [ 593.150026] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c1977980c94638895291641","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c1977980c94638895291641: done: 0.023718 sec","job_status":"done","queue_duration_s":1.811217,"scheduling_latency_s":1.811248,"redis_calls":13,"redis_duration_s":0.003788,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001398,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00239,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015456,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023718,"completed_at":"2026-09-04T07:34:03.798Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2955gitlab # [ 593.190005] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e556be79c099800e49f8119","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e556be79c099800e49f8119: start","job_status":"start","queue_duration_s":1.837082,"scheduling_latency_s":1.837116}2956gitlab # [ 593.202538] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e556be79c099800e49f8119","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e556be79c099800e49f8119: done: 0.030266 sec","job_status":"done","queue_duration_s":1.837082,"scheduling_latency_s":1.837116,"redis_calls":13,"redis_duration_s":0.004296,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002743,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020596,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030266,"completed_at":"2026-09-04T07:34:03.830Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2957gitlab # [ 593.241417] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.834Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c85f95410c8245c547a7caae","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c85f95410c8245c547a7caae: start","job_status":"start","queue_duration_s":1.871171,"scheduling_latency_s":1.871209}2958gitlab # [ 593.254575] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.862Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c85f95410c8245c547a7caae","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c85f95410c8245c547a7caae: done: 0.028059 sec","job_status":"done","queue_duration_s":1.871171,"scheduling_latency_s":1.871209,"redis_calls":13,"redis_duration_s":0.004512,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00203,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002482,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01785,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028059,"completed_at":"2026-09-04T07:34:03.862Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2959gitlab # [ 593.295501] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab97a59ad3941db1f9f0137e","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab97a59ad3941db1f9f0137e: start","job_status":"start","queue_duration_s":1.901309,"scheduling_latency_s":1.901344}2960gitlab # [ 593.308370] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.892Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab97a59ad3941db1f9f0137e","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab97a59ad3941db1f9f0137e: done: 0.027377 sec","job_status":"done","queue_duration_s":1.901309,"scheduling_latency_s":1.901344,"redis_calls":13,"redis_duration_s":0.003933,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001254,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002679,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01829,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027377,"completed_at":"2026-09-04T07:34:03.892Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2961gitlab # [ 593.366849] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.895Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d986ea06ac6286732f80f47d","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d986ea06ac6286732f80f47d: start","job_status":"start","queue_duration_s":1.931945,"scheduling_latency_s":1.931982}2962gitlab # [ 593.383504] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.920Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d986ea06ac6286732f80f47d","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d986ea06ac6286732f80f47d: done: 0.024456 sec","job_status":"done","queue_duration_s":1.931945,"scheduling_latency_s":1.931982,"redis_calls":13,"redis_duration_s":0.003206,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001084,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002122,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015421,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024456,"completed_at":"2026-09-04T07:34:03.919Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2963gitlab # [ 593.431133] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.922Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dba8619362749480ab1a8aa2","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dba8619362749480ab1a8aa2: start","job_status":"start","queue_duration_s":1.958259,"scheduling_latency_s":1.958289}2964gitlab # [ 593.446257] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.947Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dba8619362749480ab1a8aa2","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dba8619362749480ab1a8aa2: done: 0.025965 sec","job_status":"done","queue_duration_s":1.958259,"scheduling_latency_s":1.958289,"redis_calls":13,"redis_duration_s":0.0032459999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001042,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002204,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017247,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025965,"completed_at":"2026-09-04T07:34:03.947Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2965gitlab # [ 593.495413] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.949Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9211c05113f1266e09fd6f1","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9211c05113f1266e09fd6f1: start","job_status":"start","queue_duration_s":1.98606,"scheduling_latency_s":1.986091}2966gitlab # [ 593.509529] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.975Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9211c05113f1266e09fd6f1","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9211c05113f1266e09fd6f1: done: 0.025666 sec","job_status":"done","queue_duration_s":1.98606,"scheduling_latency_s":1.986091,"redis_calls":13,"redis_duration_s":0.002609,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00168,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025666,"completed_at":"2026-09-04T07:34:03.975Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2967gitlab # [ 593.552357] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:03.978Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64d12a7c4c245bf7fb6142a5","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64d12a7c4c245bf7fb6142a5: start","job_status":"start","queue_duration_s":2.014819,"scheduling_latency_s":2.014859}2968gitlab # [ 593.565854] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.021Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64d12a7c4c245bf7fb6142a5","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64d12a7c4c245bf7fb6142a5: done: 0.042489 sec","job_status":"done","queue_duration_s":2.014819,"scheduling_latency_s":2.014859,"redis_calls":13,"redis_duration_s":0.0037600000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001364,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002396,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030482,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.042489,"completed_at":"2026-09-04T07:34:04.020Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2969gitlab # [ 593.608563] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.023Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11d2b10d9a32aac43367bf41","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11d2b10d9a32aac43367bf41: start","job_status":"start","queue_duration_s":2.059904,"scheduling_latency_s":2.059952}2970gitlab # [ 593.621917] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.059Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11d2b10d9a32aac43367bf41","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11d2b10d9a32aac43367bf41: done: 0.035829 sec","job_status":"done","queue_duration_s":2.059904,"scheduling_latency_s":2.059952,"redis_calls":13,"redis_duration_s":0.004283,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00138,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035829,"completed_at":"2026-09-04T07:34:04.059Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2971gitlab # [ 593.664235] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c913f47cc61920b0ddf40fd8","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c913f47cc61920b0ddf40fd8: start","job_status":"start","queue_duration_s":2.098516,"scheduling_latency_s":2.098556}2972gitlab # [ 593.678097] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.102Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c913f47cc61920b0ddf40fd8","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c913f47cc61920b0ddf40fd8: done: 0.039928 sec","job_status":"done","queue_duration_s":2.098516,"scheduling_latency_s":2.098556,"redis_calls":13,"redis_duration_s":0.005631,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001606,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004025,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028718,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.039928,"completed_at":"2026-09-04T07:34:04.102Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2973gitlab # [ 593.719744] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.105Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c2f1f25c9b7ef89d3234885","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c2f1f25c9b7ef89d3234885: start","job_status":"start","queue_duration_s":2.141472,"scheduling_latency_s":2.141511}2974gitlab # [ 593.733517] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.137Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c2f1f25c9b7ef89d3234885","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c2f1f25c9b7ef89d3234885: done: 0.032241 sec","job_status":"done","queue_duration_s":2.141472,"scheduling_latency_s":2.141511,"redis_calls":13,"redis_duration_s":0.003537,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001386,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002151,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018305,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032241,"completed_at":"2026-09-04T07:34:04.137Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2975gitlab # [ 593.773449] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.142Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa54fa40918f0bc1724a52eb","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa54fa40918f0bc1724a52eb: start","job_status":"start","queue_duration_s":2.178739,"scheduling_latency_s":2.178786}2976gitlab # [ 593.785821] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.174Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa54fa40918f0bc1724a52eb","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa54fa40918f0bc1724a52eb: done: 0.032467 sec","job_status":"done","queue_duration_s":2.178739,"scheduling_latency_s":2.178786,"redis_calls":13,"redis_duration_s":0.003234,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001193,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002041,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032467,"completed_at":"2026-09-04T07:34:04.174Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2977gitlab # [ 593.826782] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4f37dbb83d54754b8b585eb","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4f37dbb83d54754b8b585eb: start","job_status":"start","queue_duration_s":2.213205,"scheduling_latency_s":2.21324}2978gitlab # [ 593.839616] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.203Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4f37dbb83d54754b8b585eb","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4f37dbb83d54754b8b585eb: done: 0.026334 sec","job_status":"done","queue_duration_s":2.213205,"scheduling_latency_s":2.21324,"redis_calls":13,"redis_duration_s":0.0036320000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00117,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002462,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017168,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026334,"completed_at":"2026-09-04T07:34:04.203Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2979gitlab # [ 593.879413] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.205Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32c97bf7a9bccde22ccf6599","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32c97bf7a9bccde22ccf6599: start","job_status":"start","queue_duration_s":2.24164,"scheduling_latency_s":2.241674}2980gitlab # [ 593.891919] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.230Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32c97bf7a9bccde22ccf6599","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32c97bf7a9bccde22ccf6599: done: 0.02559 sec","job_status":"done","queue_duration_s":2.24164,"scheduling_latency_s":2.241674,"redis_calls":13,"redis_duration_s":0.003748,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001261,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002487,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016421,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02559,"completed_at":"2026-09-04T07:34:04.230Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2981gitlab # [ 593.930927] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.233Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa779ccd1012c510f7e4441d","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa779ccd1012c510f7e4441d: start","job_status":"start","queue_duration_s":2.269312,"scheduling_latency_s":2.269346}2982gitlab # [ 593.943304] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.260Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa779ccd1012c510f7e4441d","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa779ccd1012c510f7e4441d: done: 0.027204 sec","job_status":"done","queue_duration_s":2.269312,"scheduling_latency_s":2.269346,"redis_calls":13,"redis_duration_s":0.003472,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001173,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002299,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013621,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027204,"completed_at":"2026-09-04T07:34:04.260Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2983gitlab # [ 593.982199] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2582209fe300391cb976ba18","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2582209fe300391cb976ba18: start","job_status":"start","queue_duration_s":2.298523,"scheduling_latency_s":2.298551}2984gitlab # [ 593.994557] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2582209fe300391cb976ba18","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2582209fe300391cb976ba18: done: 0.021769 sec","job_status":"done","queue_duration_s":2.298523,"scheduling_latency_s":2.298551,"redis_calls":13,"redis_duration_s":0.004522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001225,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003297,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013754,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021769,"completed_at":"2026-09-04T07:34:04.283Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2985gitlab # [ 594.034686] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.286Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ca335a121a1c675586f887f","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ca335a121a1c675586f887f: start","job_status":"start","queue_duration_s":2.322242,"scheduling_latency_s":2.322272}2986gitlab # [ 594.046974] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.307Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ca335a121a1c675586f887f","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ca335a121a1c675586f887f: done: 0.021342 sec","job_status":"done","queue_duration_s":2.322242,"scheduling_latency_s":2.322272,"redis_calls":13,"redis_duration_s":0.003282,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001125,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002157,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013528,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021342,"completed_at":"2026-09-04T07:34:04.307Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2987gitlab # [ 594.086709] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.309Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9765e164c911ceca9433001","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9765e164c911ceca9433001: start","job_status":"start","queue_duration_s":2.345424,"scheduling_latency_s":2.345454}2988gitlab # [ 594.100705] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.334Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9765e164c911ceca9433001","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9765e164c911ceca9433001: done: 0.025056 sec","job_status":"done","queue_duration_s":2.345424,"scheduling_latency_s":2.345454,"redis_calls":13,"redis_duration_s":0.003307,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001161,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002146,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014105,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025056,"completed_at":"2026-09-04T07:34:04.334Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2989gitlab # [ 594.143367] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.336Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"830e54cf89e41e5cbce252ec","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-830e54cf89e41e5cbce252ec: start","job_status":"start","queue_duration_s":2.372497,"scheduling_latency_s":2.372528}2990gitlab # [ 594.157172] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.361Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"830e54cf89e41e5cbce252ec","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-830e54cf89e41e5cbce252ec: done: 0.025613 sec","job_status":"done","queue_duration_s":2.372497,"scheduling_latency_s":2.372528,"redis_calls":13,"redis_duration_s":0.00356,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001235,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002325,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016716,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025613,"completed_at":"2026-09-04T07:34:04.361Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2991gitlab # [ 594.196481] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.364Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"049c9875bc522a85fdc01698","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-049c9875bc522a85fdc01698: start","job_status":"start","queue_duration_s":2.401176,"scheduling_latency_s":2.401209}2992gitlab # [ 594.208757] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.392Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"049c9875bc522a85fdc01698","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-049c9875bc522a85fdc01698: done: 0.0275 sec","job_status":"done","queue_duration_s":2.401176,"scheduling_latency_s":2.401209,"redis_calls":13,"redis_duration_s":0.005124,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001235,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003889,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0275,"completed_at":"2026-09-04T07:34:04.392Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2993gitlab # [ 594.250359] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.394Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c9d404170673e6fd0ec3c12","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c9d404170673e6fd0ec3c12: start","job_status":"start","queue_duration_s":2.430841,"scheduling_latency_s":2.430877}2994gitlab # [ 594.264417] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.434Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c9d404170673e6fd0ec3c12","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c9d404170673e6fd0ec3c12: done: 0.039564 sec","job_status":"done","queue_duration_s":2.430841,"scheduling_latency_s":2.430877,"redis_calls":13,"redis_duration_s":0.005294,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003788,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02853,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.039564,"completed_at":"2026-09-04T07:34:04.434Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2995gitlab # [ 594.306735] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b033230b7ed034b7ca9e2351","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b033230b7ed034b7ca9e2351: start","job_status":"start","queue_duration_s":2.47616,"scheduling_latency_s":2.47622}2996gitlab # [ 594.320307] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.478Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b033230b7ed034b7ca9e2351","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b033230b7ed034b7ca9e2351: done: 0.039158 sec","job_status":"done","queue_duration_s":2.47616,"scheduling_latency_s":2.47622,"redis_calls":13,"redis_duration_s":0.003796,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001324,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002472,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.039158,"completed_at":"2026-09-04T07:34:04.478Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2997gitlab # [ 594.359844] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.482Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7319ec426769afc8a8116b98","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7319ec426769afc8a8116b98: start","job_status":"start","queue_duration_s":2.518378,"scheduling_latency_s":2.518425}2998gitlab # [ 594.372249] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.518Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7319ec426769afc8a8116b98","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7319ec426769afc8a8116b98: done: 0.036849 sec","job_status":"done","queue_duration_s":2.518378,"scheduling_latency_s":2.518425,"redis_calls":13,"redis_duration_s":0.004814,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001671,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003143,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036849,"completed_at":"2026-09-04T07:34:04.518Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2999gitlab # [ 594.411256] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.523Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11f08da514836266d8608c96","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11f08da514836266d8608c96: start","job_status":"start","queue_duration_s":2.559482,"scheduling_latency_s":2.559524}3000gitlab # [ 594.424194] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.554Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11f08da514836266d8608c96","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11f08da514836266d8608c96: done: 0.031441 sec","job_status":"done","queue_duration_s":2.559482,"scheduling_latency_s":2.559524,"redis_calls":13,"redis_duration_s":0.003997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001397,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031441,"completed_at":"2026-09-04T07:34:04.554Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}3001gitlab # [ 594.466177] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.559Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71f195f48ad4f8011d134052","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71f195f48ad4f8011d134052: start","job_status":"start","queue_duration_s":2.596026,"scheduling_latency_s":2.596096}3002gitlab # [ 594.479771] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.608Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71f195f48ad4f8011d134052","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71f195f48ad4f8011d134052: done: 0.049232 sec","job_status":"done","queue_duration_s":2.596026,"scheduling_latency_s":2.596096,"redis_calls":13,"redis_duration_s":0.006871,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003485,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003386,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031433,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.049232,"completed_at":"2026-09-04T07:34:04.608Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}3003gitlab # [ 594.520929] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.612Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da4483b8a5c7638df5a024b6","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da4483b8a5c7638df5a024b6: start","job_status":"start","queue_duration_s":2.64839,"scheduling_latency_s":2.648442}3004gitlab # [ 594.534573] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.646Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da4483b8a5c7638df5a024b6","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da4483b8a5c7638df5a024b6: done: 0.034429 sec","job_status":"done","queue_duration_s":2.64839,"scheduling_latency_s":2.648442,"redis_calls":13,"redis_duration_s":0.003969,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001393,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002576,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022528,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034429,"completed_at":"2026-09-04T07:34:04.646Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}3005gitlab # [ 594.576632] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.649Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c13b8385b090d4ef528faf1a","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c13b8385b090d4ef528faf1a: start","job_status":"start","queue_duration_s":2.685799,"scheduling_latency_s":2.685839}3006gitlab # [ 594.589816] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.674Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c13b8385b090d4ef528faf1a","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c13b8385b090d4ef528faf1a: done: 0.025054 sec","job_status":"done","queue_duration_s":2.685799,"scheduling_latency_s":2.685839,"redis_calls":13,"redis_duration_s":0.0036379999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001254,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002384,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015538,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025054,"completed_at":"2026-09-04T07:34:04.674Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}3007gitlab # [ 594.629841] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.676Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3897648b9c2bd8b2778c19d8","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3897648b9c2bd8b2778c19d8: start","job_status":"start","queue_duration_s":2.712885,"scheduling_latency_s":2.712919}3008gitlab # [ 594.642459] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.698Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3897648b9c2bd8b2778c19d8","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3897648b9c2bd8b2778c19d8: done: 0.022282 sec","job_status":"done","queue_duration_s":2.712885,"scheduling_latency_s":2.712919,"redis_calls":13,"redis_duration_s":0.003404,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001132,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002272,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013404,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022282,"completed_at":"2026-09-04T07:34:04.698Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}3009gitlab # [ 594.684047] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.700Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c46febf12bd3d7abcb3fdcd","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c46febf12bd3d7abcb3fdcd: start","job_status":"start","queue_duration_s":2.737038,"scheduling_latency_s":2.737069}3010gitlab # [ 594.696694] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.721Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c46febf12bd3d7abcb3fdcd","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c46febf12bd3d7abcb3fdcd: done: 0.020528 sec","job_status":"done","queue_duration_s":2.737038,"scheduling_latency_s":2.737069,"redis_calls":13,"redis_duration_s":0.003226,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002177,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012331,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020528,"completed_at":"2026-09-04T07:34:04.721Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}3011gitlab # [ 594.737586] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.723Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c9428e19af5b8c0d68c54a9","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c9428e19af5b8c0d68c54a9: start","job_status":"start","queue_duration_s":2.759488,"scheduling_latency_s":2.759518}3012gitlab # [ 594.750838] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c9428e19af5b8c0d68c54a9","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c9428e19af5b8c0d68c54a9: done: 0.020145 sec","job_status":"done","queue_duration_s":2.759488,"scheduling_latency_s":2.759518,"redis_calls":13,"redis_duration_s":0.0032450000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001074,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002171,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012437,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020145,"completed_at":"2026-09-04T07:34:04.743Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}3013gitlab # [ 594.791577] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.745Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2dca979c85607bfeba9012b4","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2dca979c85607bfeba9012b4: start","job_status":"start","queue_duration_s":2.781389,"scheduling_latency_s":2.781414}3014gitlab # [ 594.804716] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2dca979c85607bfeba9012b4","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2dca979c85607bfeba9012b4: done: 0.018324 sec","job_status":"done","queue_duration_s":2.781389,"scheduling_latency_s":2.781414,"redis_calls":13,"redis_duration_s":0.002618,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000948,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00167,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018324,"completed_at":"2026-09-04T07:34:04.763Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}3015gitlab # [ 594.845176] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5cae27ebc1454f3bfa4f0609","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5cae27ebc1454f3bfa4f0609: start","job_status":"start","queue_duration_s":2.801337,"scheduling_latency_s":2.80136}3016gitlab # [ 594.858914] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.784Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5cae27ebc1454f3bfa4f0609","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5cae27ebc1454f3bfa4f0609: done: 0.019424 sec","job_status":"done","queue_duration_s":2.801337,"scheduling_latency_s":2.80136,"redis_calls":13,"redis_duration_s":0.0030540000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001027,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002027,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019424,"completed_at":"2026-09-04T07:34:04.784Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}3017gitlab # [ 594.898947] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.786Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32c2609f453bb637f4fe2c78","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32c2609f453bb637f4fe2c78: start","job_status":"start","queue_duration_s":2.822536,"scheduling_latency_s":2.822559}3018gitlab # [ 594.912663] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.821Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32c2609f453bb637f4fe2c78","created_at":"2026-09-04T07:34:01.351Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-a8dd09c042784878","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"059339cfeb21a3ba558b97220f08bfda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.963Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32c2609f453bb637f4fe2c78: done: 0.034787 sec","job_status":"done","queue_duration_s":2.822536,"scheduling_latency_s":2.822559,"redis_calls":13,"redis_duration_s":0.004497,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001822,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002675,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02087,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034787,"completed_at":"2026-09-04T07:34:04.820Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}3019gitlab # [ 594.955364] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.824Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"5dec018386826c401600ecf6","created_at":"2026-09-04T07:34:01.967Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"842a1621d1672886fa9e7c0f3cc01c6e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.982Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-5dec018386826c401600ecf6: start","job_status":"start","queue_duration_s":2.84203,"scheduling_latency_s":2.84208}3020gitlab # [ 594.970872] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.846Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}3021gitlab # [ 594.974400] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.859Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"5dec018386826c401600ecf6","created_at":"2026-09-04T07:34:01.967Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"842a1621d1672886fa9e7c0f3cc01c6e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:01.982Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-5dec018386826c401600ecf6: done: 0.03504 sec","job_status":"done","queue_duration_s":2.84203,"scheduling_latency_s":2.84208,"redis_calls":7,"redis_duration_s":0.00288,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002085,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000795,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03504,"completed_at":"2026-09-04T07:34:04.859Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}3022gitlab # [ 595.016122] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.862Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"fa1ad59a9919bff2b0928c22","created_at":"2026-09-04T07:34:02.008Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c83ffa4dc9356eda2df8fcadb64454d3","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:02.120Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-fa1ad59a9919bff2b0928c22: start","job_status":"start","queue_duration_s":2.742317,"scheduling_latency_s":2.742361}3023gitlab # [ 595.030165] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.901Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"fa1ad59a9919bff2b0928c22","created_at":"2026-09-04T07:34:02.008Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c83ffa4dc9356eda2df8fcadb64454d3","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:02.120Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-fa1ad59a9919bff2b0928c22: done: 0.039103 sec","job_status":"done","queue_duration_s":2.742317,"scheduling_latency_s":2.742361,"redis_calls":12,"redis_duration_s":0.0041860000000000005,"redis_read_bytes":12,"redis_write_bytes":1098,"redis_cache_calls":3,"redis_cache_duration_s":0.001018,"redis_cache_read_bytes":5,"redis_cache_write_bytes":97,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000827,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001627,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":482,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000714,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039103,"completed_at":"2026-09-04T07:34:04.901Z","load_balancing_strategy":"primary","db_duration_s":0.001243,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}3024gitlab # [ 595.076926] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.904Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"6752d9796455c3111e4ce813","created_at":"2026-09-04T07:34:02.136Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4409957d6efdf1d0324b83a6a662042d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:02.143Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-6752d9796455c3111e4ce813: start","job_status":"start","queue_duration_s":2.760886,"scheduling_latency_s":2.760923}3025gitlab # [ 595.090697] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.951Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"6752d9796455c3111e4ce813","created_at":"2026-09-04T07:34:02.136Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4409957d6efdf1d0324b83a6a662042d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:02.143Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-6752d9796455c3111e4ce813: done: 0.047229 sec","job_status":"done","queue_duration_s":2.760886,"scheduling_latency_s":2.760923,"redis_calls":14,"redis_duration_s":0.004896,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.000533,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.003183,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00118,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.047229,"completed_at":"2026-09-04T07:34:04.951Z","load_balancing_strategy":"primary","db_duration_s":0.002761,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}3026gitlab # [ 595.131435] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.954Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"e1bc08edd4991e02b65b614e","created_at":"2026-09-04T07:34:02.153Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2431dc92a5c2ac6acbc0839cd9b83356","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:02.160Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-e1bc08edd4991e02b65b614e: start","job_status":"start","queue_duration_s":2.793333,"scheduling_latency_s":2.79379}3027gitlab # [ 595.146523] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.966Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}3028gitlab # [ 595.150470] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.975Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"e1bc08edd4991e02b65b614e","created_at":"2026-09-04T07:34:02.153Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2431dc92a5c2ac6acbc0839cd9b83356","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:02.160Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-e1bc08edd4991e02b65b614e: done: 0.021791 sec","job_status":"done","queue_duration_s":2.793333,"scheduling_latency_s":2.79379,"redis_calls":7,"redis_duration_s":0.002277,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00163,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000647,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021791,"completed_at":"2026-09-04T07:34:04.975Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}3029gitlab # [ 595.193116] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:04.977Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"19450e3f42261104184acd9e","created_at":"2026-09-04T07:34:02.176Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba64e093c6e4d894470044b91b666cd6","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:02.190Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-19450e3f42261104184acd9e: start","job_status":"start","queue_duration_s":2.787012,"scheduling_latency_s":2.787041}3030gitlab # [ 595.208094] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:05.034Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"19450e3f42261104184acd9e","created_at":"2026-09-04T07:34:02.176Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba64e093c6e4d894470044b91b666cd6","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:02.190Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-19450e3f42261104184acd9e: done: 0.057381 sec","job_status":"done","queue_duration_s":2.787012,"scheduling_latency_s":2.787041,"redis_calls":9,"redis_duration_s":0.00341,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001652,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001758,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027185,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00102946,"exclusive_lock_hold_duration_s":0.02497478,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.057381,"completed_at":"2026-09-04T07:34:05.034Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023779,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}3031gitlab # [ 595.250936] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:05.037Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"7adf0ce8bf399116673ad23f","created_at":"2026-09-04T07:34:02.217Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2e9b1812b9a8e747a4ef18c3d1e4958c","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:02.225Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-7adf0ce8bf399116673ad23f: start","job_status":"start","queue_duration_s":2.811802,"scheduling_latency_s":2.811835}3032gitlab # [ 595.266627] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:05.416Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"7adf0ce8bf399116673ad23f","created_at":"2026-09-04T07:34:02.217Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2e9b1812b9a8e747a4ef18c3d1e4958c","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:02.225Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-7adf0ce8bf399116673ad23f: done: 0.379601 sec","job_status":"done","queue_duration_s":2.811802,"scheduling_latency_s":2.811835,"redis_calls":562,"redis_duration_s":0.10800100000000001,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001464,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.106537,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.313812,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.379601,"completed_at":"2026-09-04T07:34:05.416Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}3033gitlab # [ 595.309771] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:05.418Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d112c6e3c2bbda3abaac99ac","created_at":"2026-09-04T07:34:02.259Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7169cd4f9fac179b7e70c8a1573ede90","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:02.270Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d112c6e3c2bbda3abaac99ac: start","job_status":"start","queue_duration_s":3.148061,"scheduling_latency_s":3.148094}3034gitlab # [ 595.323418] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:05.443Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d112c6e3c2bbda3abaac99ac","created_at":"2026-09-04T07:34:02.259Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7169cd4f9fac179b7e70c8a1573ede90","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:02.270Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d112c6e3c2bbda3abaac99ac: done: 0.024823 sec","job_status":"done","queue_duration_s":3.148061,"scheduling_latency_s":3.148094,"redis_calls":9,"redis_duration_s":0.002823,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001451,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001372,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014618,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00070038,"exclusive_lock_hold_duration_s":0.00652018,"duration_s":0.024823,"completed_at":"2026-09-04T07:34:05.443Z","load_balancing_strategy":"primary","db_duration_s":0.003126,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}3035gitlab # [ 595.365698] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:05.445Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"dd9343d4ed4ebb3303de7101","created_at":"2026-09-04T07:34:02.281Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f87d6fd460940548a094cad9c5841adc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:02.288Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-dd9343d4ed4ebb3303de7101: start","job_status":"start","queue_duration_s":3.156874,"scheduling_latency_s":3.156901}3036gitlab # [ 595.380381] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:05.455Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}3037gitlab # [ 595.383727] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:05.463Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"dd9343d4ed4ebb3303de7101","created_at":"2026-09-04T07:34:02.281Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f87d6fd460940548a094cad9c5841adc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:02.288Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-dd9343d4ed4ebb3303de7101: done: 0.01787 sec","job_status":"done","queue_duration_s":3.156874,"scheduling_latency_s":3.156901,"redis_calls":7,"redis_duration_s":0.0025779999999999996,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001995,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000583,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010251,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01787,"completed_at":"2026-09-04T07:34:05.463Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}3038gitlab # [ 595.425406] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:05.465Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"fb65c41c6b7d044deb4cb3e4","created_at":"2026-09-04T07:34:02.296Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d297368630b3438e8966f2b7adb2909b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:34:02.305Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-fb65c41c6b7d044deb4cb3e4: start","job_status":"start","queue_duration_s":3.159907,"scheduling_latency_s":3.159932}3039gitlab # [ 595.439027] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:05.475Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}3040gitlab # [ 595.442438] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:05.481Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"fb65c41c6b7d044deb4cb3e4","created_at":"2026-09-04T07:34:02.296Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d297368630b3438e8966f2b7adb2909b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:34:02.305Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-fb65c41c6b7d044deb4cb3e4: done: 0.016659 sec","job_status":"done","queue_duration_s":3.159907,"scheduling_latency_s":3.159932,"redis_calls":7,"redis_duration_s":0.00196,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001405,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000555,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010106,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016659,"completed_at":"2026-09-04T07:34:05.481Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}3041gitlab # [ 595.485456] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:05.483Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"872857b2d79e7d2583430a35","created_at":"2026-09-04T07:34:02.347Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc053cd994803f77c7e4d5742753c4e5","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:02.372Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-872857b2d79e7d2583430a35: start","job_status":"start","queue_duration_s":3.111169,"scheduling_latency_s":3.111193}3042gitlab # [ 595.502016] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:05.530Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"872857b2d79e7d2583430a35","created_at":"2026-09-04T07:34:02.347Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc053cd994803f77c7e4d5742753c4e5","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-04T07:34:02.372Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-872857b2d79e7d2583430a35: done: 0.046231 sec","job_status":"done","queue_duration_s":3.111169,"scheduling_latency_s":3.111193,"redis_calls":11,"redis_duration_s":0.004455,"redis_read_bytes":9,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000886,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001783,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001786,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00083022,"exclusive_lock_hold_duration_s":0.0082967,"duration_s":0.046231,"completed_at":"2026-09-04T07:34:05.530Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005463,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}3043gitlab # [ 595.544830] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:05.532Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"f707c6ab29786d517e0f6c88","created_at":"2026-09-04T07:34:02.397Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"042be3937f2be0679319169f9b67edbe","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:34:02.404Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-f707c6ab29786d517e0f6c88: start","job_status":"start","queue_duration_s":3.127959,"scheduling_latency_s":3.127989}3044gitlab # [ 595.558055] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:05.561Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"f707c6ab29786d517e0f6c88","created_at":"2026-09-04T07:34:02.397Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-43f323e5bc684cf1","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"042be3937f2be0679319169f9b67edbe","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:34:02.404Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-f707c6ab29786d517e0f6c88: done: 0.028945 sec","job_status":"done","queue_duration_s":3.127959,"scheduling_latency_s":3.127989,"redis_calls":7,"redis_duration_s":0.002325,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001679,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000646,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028945,"completed_at":"2026-09-04T07:34:05.561Z","load_balancing_strategy":"primary","db_duration_s":0.003298,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}3045gitlab # [ 595.597116] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:05.563Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b2e4af649bb27936ff1bce3b","created_at":"2026-09-04T07:34:04.925Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-1326418228614822","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4409957d6efdf1d0324b83a6a662042d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:04.941Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b2e4af649bb27936ff1bce3b: start","job_status":"start","queue_duration_s":0.621954,"scheduling_latency_s":0.621988}3046gitlab # [ 595.609368] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:05.579Z","message":"No existing merge request to be cleaned up."}3047gitlab # [ 595.611076] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:05.593Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b2e4af649bb27936ff1bce3b","created_at":"2026-09-04T07:34:04.925Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-1326418228614822","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4409957d6efdf1d0324b83a6a662042d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:04.941Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b2e4af649bb27936ff1bce3b: done: 0.029504 sec","job_status":"done","queue_duration_s":0.621954,"scheduling_latency_s":0.621988,"redis_calls":10,"redis_duration_s":0.003218,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001336,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001882,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018707,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029504,"completed_at":"2026-09-04T07:34:05.593Z","load_balancing_strategy":"primary","db_duration_s":0.004026,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}3048gitlab # [ 595.649895] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:05.595Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e7015f6036fb21ea72532146","created_at":"2026-09-04T07:34:04.925Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-1326418228614822","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4409957d6efdf1d0324b83a6a662042d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:04.941Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e7015f6036fb21ea72532146: start","job_status":"start","queue_duration_s":0.653403,"scheduling_latency_s":0.653435}3049gitlab # [ 595.662385] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:05.610Z","message":"No existing merge request to be cleaned up."}3050gitlab # [ 595.664146] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:05.623Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e7015f6036fb21ea72532146","created_at":"2026-09-04T07:34:04.925Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-1326418228614822","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4409957d6efdf1d0324b83a6a662042d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:04.941Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e7015f6036fb21ea72532146: done: 0.028053 sec","job_status":"done","queue_duration_s":0.653403,"scheduling_latency_s":0.653435,"redis_calls":10,"redis_duration_s":0.0032700000000000003,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001368,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001902,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01793,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028053,"completed_at":"2026-09-04T07:34:05.623Z","load_balancing_strategy":"primary","db_duration_s":0.003623,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}3051gitlab # [ 595.705867] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:05.625Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b0d89401fbcec4ba84ff4a23","created_at":"2026-09-04T07:34:04.925Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-1326418228614822","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4409957d6efdf1d0324b83a6a662042d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:04.941Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b0d89401fbcec4ba84ff4a23: start","job_status":"start","queue_duration_s":0.683589,"scheduling_latency_s":0.683619}3052gitlab # [ 595.718676] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:05.640Z","message":"No existing merge request to be cleaned up."}3053gitlab # [ 595.720448] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:05.653Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b0d89401fbcec4ba84ff4a23","created_at":"2026-09-04T07:34:04.925Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-1326418228614822","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4409957d6efdf1d0324b83a6a662042d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:04.941Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b0d89401fbcec4ba84ff4a23: done: 0.028473 sec","job_status":"done","queue_duration_s":0.683589,"scheduling_latency_s":0.683619,"redis_calls":10,"redis_duration_s":0.0033410000000000002,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001449,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001892,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028473,"completed_at":"2026-09-04T07:34:05.653Z","load_balancing_strategy":"primary","db_duration_s":0.003646,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}3054gitlab # [ 595.761352] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:05.655Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"28b7bf3ae21318f01dba984e","created_at":"2026-09-04T07:34:04.925Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-1326418228614822","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4409957d6efdf1d0324b83a6a662042d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:04.941Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-28b7bf3ae21318f01dba984e: start","job_status":"start","queue_duration_s":0.714035,"scheduling_latency_s":0.714066}3055gitlab # [ 595.774134] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:05.671Z","message":"No existing merge request to be cleaned up."}3056gitlab # [ 595.775864] sidekiq-cluster[3873]: {"severity":"INFO","time":"2026-09-04T07:34:05.684Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"28b7bf3ae21318f01dba984e","created_at":"2026-09-04T07:34:04.925Z","trace_propagation_headers":{"sentry-trace":"8b3ea0d9e5cc4769bea1f1b2f949e990-1326418228614822","baggage":"sentry-trace_id=8b3ea0d9e5cc4769bea1f1b2f949e990,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4409957d6efdf1d0324b83a6a662042d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:34:04.941Z","job_size_bytes":2,"pid":3873,"sidekiq_tid":"m925","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-28b7bf3ae21318f01dba984e: done: 0.028288 sec","job_status":"done","queue_duration_s":0.714035,"scheduling_latency_s":0.714066,"redis_calls":10,"redis_duration_s":0.003365,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001442,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001923,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028288,"completed_at":"2026-09-04T07:34:05.683Z","load_balancing_strategy":"primary","db_duration_s":0.003651,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}3057gitlab # [ 611.179220] redis[790]: 10 changes in 300 seconds. Saving...3058gitlab # [ 611.185877] redis[790]: Background saving started by pid 50503059gitlab # [ 611.193877] redis[5050]: BGSAVE done, 785 keys saved, 0 keys skipped, 173351 bytes written.3060gitlab # [ 611.199475] redis[5050]: DB saved on disk3061gitlab # [ 611.201805] redis[5050]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB3062gitlab # [ 611.280448] redis[790]: Background saving terminated with success3063gitlab # [ 612.788483] gitaly[896]: time="2026-09-04T07:34:34.673Z" level=info msg="burden monitor stats" pid=8963064gitlab # [ 618.457410] postgres[5051]: [5051] ERROR: relation "table_without_models" does not exist3065gitlab # [ 618.457815] postgres[5051]: [5051] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')3066gitlab # [ 623.936243] runuser[4622]: pam_unix(runuser:session): session closed for user gitlab3067!!! Test "push delivers the webhook" failed with error: "action timed out after 120.75 seconds (timeout=120)"3068!!! Traceback (most recent call last):3069!!! File "<string>", line 50, in <module>3070!!! retry(build_created, timeout_seconds=120)3071!!! 3072!!! RequestedAssertionFailed: action timed out after 120.75 seconds (timeout=120)3073cleanup3074kill QemuMachine (pid 46)3075gitlab # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)3076(finished: cleanup, in 1.73 seconds)3077additionally exposed symbols:3078 gitlab,3079 vlan1,3080 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh3081[]3082[]3083[]3084[]3085[]3086[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-04T07:30:55.489Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]3087[]3088[]3089[]3090[]3091[]3092[]3093[]3094[]3095[]3096[]3097[]3098[]3099[]3100[]3101[]3102[]3103[]3104[]3105[]3106[]3107[]3108[]3109[]3110[]3111[]3112[]3113[]3114[]3115[]3116[]3117[]3118[]3119[]3120[]3121[]3122[]3123[]3124[]3125[]3126[]3127[]3128[]3129[]3130[]3131[]3132[]3133[]3134[]3135[]3136[]3137[]3138[]3139[]3140[]3141[]3142[]3143[]3144[]3145[]3146[]3147[]3148[]3149[]3150[]3151[]3152[]3153[]3154[]3155[]3156[]3157[]3158[]3159[]3160[]3161[]3162[]3163[]3164[]3165[]3166[]3167[]3168[]3169[]3170[]3171[]3172[]3173[]3174[]3175[]3176[]3177[]3178[]3179[]3180[]3181[]3182[]3183[]3184[]3185[]3186[]3187[]3188[]3189[]3190[]3191[]3192[]3193[]3194[]3195[]3196[]3197[]3198[]3199[]3200[]3201[]3202Sep 04 07:32:07 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:39790 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3203Sep 04 07:32:08 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:39792 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3204Sep 04 07:32:09 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:39808 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3205Sep 04 07:32:10 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:39824 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3206Sep 04 07:32:11 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:39826 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3207Sep 04 07:32:12 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:39828 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3208Sep 04 07:32:13 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:53756 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3209Sep 04 07:32:14 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:53770 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3210Sep 04 07:32:15 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:53776 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3211Sep 04 07:32:16 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:53778 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3212Sep 04 07:32:17 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:53780 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3213Sep 04 07:32:18 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:53792 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3214Sep 04 07:32:19 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:53806 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3215Sep 04 07:32:20 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:53822 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3216Sep 04 07:32:22 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:53830 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3217Sep 04 07:32:23 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:56146 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3218Sep 04 07:32:24 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:56152 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3219Sep 04 07:32:25 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:56164 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3220Sep 04 07:32:26 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:56168 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3221Sep 04 07:32:27 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:56174 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3222Sep 04 07:32:28 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:56186 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3223Sep 04 07:32:29 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:56202 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3224Sep 04 07:32:30 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:56210 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3225Sep 04 07:32:31 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:56214 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3226Sep 04 07:32:32 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:56226 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3227Sep 04 07:32:33 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:53652 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3228Sep 04 07:32:34 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:53666 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3229Sep 04 07:32:35 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:53674 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3230Sep 04 07:32:36 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:53680 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3231Sep 04 07:32:37 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:53694 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3232Sep 04 07:32:39 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:53710 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3233Sep 04 07:32:40 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:53724 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3234Sep 04 07:32:41 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:53738 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3235Sep 04 07:32:42 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:53744 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3236Sep 04 07:32:43 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:49634 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3237Sep 04 07:32:44 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:49648 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3238Sep 04 07:32:45 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:49652 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3239Sep 04 07:32:46 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:49654 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3240Sep 04 07:32:47 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:49662 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3241Sep 04 07:32:48 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:49664 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3242Sep 04 07:32:49 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:49668 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3243Sep 04 07:32:50 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:49678 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3244Sep 04 07:32:51 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:49684 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3245Sep 04 07:32:52 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:52706 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3246Sep 04 07:32:53 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:52716 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3247Sep 04 07:32:55 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:52722 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3248Sep 04 07:32:56 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:52736 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3249Sep 04 07:32:57 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:52738 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3250Sep 04 07:32:58 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:52742 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK3251Sep 04 07:32:59 gitlab nixbot[3856]: INFO: ::ffff:127.0.0.1:52756 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fa1e5af9ac2e46d0ceae88aab696ebae7fc135c5 HTTP/1.1" 200 OK32523253["http://buildbot:8010/webhooks/gitlab", "202", nil, "accepted"]3254["http://buildbot:8010/webhooks/gitlab", "202", nil, "accepted"]3255