vm-test-run-nixbot-gitlab
checks.aarch64-linux.nixbot-gitlab
· build #387
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.N8pdrcN63L', fmt=raw size=107374182412(finished: start all VMs, in 74.28 seconds)13gitlab # mke2fs 1.47.4 (6-Mar-2025)14gitlab: waiting for unit setup-gitlab.service15gitlab # Discarding device blocks: 0/262144 done16gitlab: waiting for the VM to finish booting17gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes18gitlab # Filesystem UUID: d1d3672d-3fe8-4834-9786-717f03f68ca919gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0i15lqnlaw69sr82rxrzb40c710b25vv-nixos-system-gitlab-test/init regInfo=/nix/store/s8hspnyinr1dy6mpv529xh61bx343yq9-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/s8hspnyinr1dy6mpv529xh61bx343yq9-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000036] arm-pv: using stolen time PV108gitlab # [ 0.000429] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000656] Console: colour dummy device 80x25110gitlab # [ 0.000665] printk: legacy console [tty0] enabled111gitlab # [ 0.000860] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000866] pid_max: default: 32768 minimum: 301113gitlab # [ 0.000940] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.001091] landlock: Up and running.115gitlab # [ 0.001094] Yama: becoming mindful.116gitlab # [ 0.001575] LSM support for eBPF active117gitlab # [ 0.002091] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.002200] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.003425] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.004227] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.004232] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.004441] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.005525] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.005624] EFI services will not be available.125gitlab # [ 0.005821] smp: Bringing up secondary CPUs ...126gitlab # [ 0.006501] Detected PIPT I-cache on CPU1127gitlab # [ 0.006610] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.006752] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000129gitlab # [ 0.006901] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.008111] Detected PIPT I-cache on CPU2131gitlab # [ 0.008231] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.008371] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000133gitlab # [ 0.008516] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.009716] Detected PIPT I-cache on CPU3135gitlab # [ 0.009844] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.009989] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000137gitlab # [ 0.010147] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.010731] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.010758] SMP: Total of 4 processors activated.140gitlab # [ 0.010761] CPU: All CPU(s) started at EL1141gitlab # [ 0.010772] CPU features: detected: Branch Target Identification142gitlab # [ 0.010776] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.010779] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.010782] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.010786] CPU features: detected: Common not Private translations146gitlab # [ 0.010789] CPU features: detected: CRC32 instructions147gitlab # [ 0.010791] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.010794] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.010797] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.010800] CPU features: detected: E0PD151gitlab # [ 0.010802] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.010805] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.010808] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.010811] CPU features: detected: Fine Grained Traps155gitlab # [ 0.010813] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.010817] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.010820] CPU features: detected: LSE atomic instructions158gitlab # [ 0.010822] CPU features: detected: Privileged Access Never159gitlab # [ 0.010831] CPU features: detected: PMUv3160gitlab # [ 0.010834] CPU features: detected: RAS Extension Support161gitlab # [ 0.010837] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.010839] CPU features: detected: Random Number Generator163gitlab # [ 0.010841] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.010844] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.010846] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.010850] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.010993] alternatives: applying system-wide alternatives168gitlab # [ 0.014189] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.014436] Memory: 5963760K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.016523] devtmpfs: initialized171gitlab # [ 0.020857] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.020924] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.021117] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.021121] 0 pages in range for non-PLT usage175gitlab # [ 0.021123] 508288 pages in range for PLT usage176gitlab # [ 0.021247] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.022099] DMI not present or invalid.178gitlab # [ 0.025466] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.028122] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.028431] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.030779] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.030812] audit: initializing netlink subsys (disabled)183gitlab # [ 0.031215] audit: type=2000 audit(0.028:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.031756] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.031759] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.031764] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.031767] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.031772] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.031946] cpuidle: using governor ladder190gitlab # [ 0.031995] cpuidle: using governor menu191gitlab # [ 0.032225] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.032516] ASID allocator initialised with 65536 entries193gitlab # [ 0.033919] Serial: AMBA PL011 UART driver194gitlab # [ 0.039482] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.039855] printk: console [ttyAMA0] enabled196gitlab # [ 0.050721] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.050761] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.050774] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.050782] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.050791] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.050798] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.050807] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.050815] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.065486] fbcon: Taking over console205gitlab # [ 0.065546] ACPI: Interpreter disabled.206gitlab # [ 0.069655] iommu: Default domain type: Translated207gitlab # [ 0.069666] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.078426] SCSI subsystem initialized209gitlab # [ 0.078925] usbcore: registered new interface driver usbfs210gitlab # [ 0.078970] usbcore: registered new interface driver hub211gitlab # [ 0.079018] usbcore: registered new device driver usb212gitlab # [ 0.079547] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.079553] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.079574] PTP clock support registered215gitlab # [ 0.079643] EDAC MC: Ver: 3.0.0216gitlab # [ 0.080389] scmi_core: SCMI protocol bus registered217gitlab # [ 0.081550] FPGA manager framework218gitlab # [ 0.082633] vgaarb: loaded219gitlab # [ 0.085281] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.102837] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.102949] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.103989] netfs: FS-Cache loaded223gitlab # [ 0.104405] pnp: PnP ACPI: disabled224gitlab # [ 0.121375] NET: Registered PF_INET protocol family225gitlab # [ 0.124334] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.184795] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.184875] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.184949] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.185416] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.186218] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.186375] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.186447] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.186615] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.186900] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.186934] NET: Registered PF_XDP protocol family236gitlab # [ 0.186956] PCI: CLS 0 bytes, default 64237gitlab # [ 0.187356] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.201454] kvm [1]: HYP mode not available239gitlab # [ 0.276991] Initialise system trusted keyrings240gitlab # [ 0.277506] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.278368] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.278611] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.296755] Key type asymmetric registered244gitlab # [ 0.296776] Asymmetric key parser 'x509' registered245gitlab # [ 0.296900] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.297216] io scheduler mq-deadline registered247gitlab # [ 0.297223] io scheduler kyber registered248gitlab # [ 0.304252] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.305493] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.306130] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.306151] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.306168] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.306183] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.306227] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.306300] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.306435] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.306445] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.306451] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.306455] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.306460] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.306631] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.307432] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.307753] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.307772] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.307812] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.307830] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.308639] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.308979] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.308997] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.309035] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.309850] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.310184] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.310201] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.310239] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.311045] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.311366] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.311383] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.311422] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.312213] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.312536] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.312553] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.312597] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.313391] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.313705] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.313722] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.313763] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.314548] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.314855] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.314872] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.314911] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.314928] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.315758] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.316068] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.316107] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.316896] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.317216] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.317278] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.318009] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.318315] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.318710] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.319137] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.319155] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.319202] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.320033] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.320350] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.320367] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.320414] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.321400] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.321410] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.321416] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.321488] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.321553] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.321620] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.321694] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.321770] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.321837] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.321909] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.321983] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.322049] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.322144] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.322210] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.322236] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.322262] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.322288] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.322314] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.322348] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.322374] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.322402] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.322428] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.322462] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.322490] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.322523] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.322549] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.322576] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.322602] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.322628] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.322655] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.322689] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.322715] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.322749] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.322775] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.322808] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.322815] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.322820] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.324831] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.343569] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.346467] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.349375] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.352384] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.358764] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.361456] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.364175] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.366912] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.373130] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.375487] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.378545] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.387646] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.390613] msm_serial: driver initialized359gitlab # [ 0.390870] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.390940] STM32 USART driver initialized361gitlab # [ 0.420689] loop: module loaded362gitlab # [ 0.420961] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.423415] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.425993] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.428264] virtio_blk virtio5: [vdb] 12285464 512-byte logical blocks (6.29 GB/5.86 GiB)366gitlab # [ 0.431034] megasas: 07.734.00.00-rc1367gitlab # [ 0.431922] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.434615] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.434642] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.436508] Using buffer write method371gitlab # [ 0.436557] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.438518] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.438540] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.440506] Using buffer write method375gitlab # [ 0.440521] Concatenating MTD devices:376gitlab # [ 0.440524] (0): "0.flash"377gitlab # [ 0.440527] (1): "0.flash"378gitlab # [ 0.440529] into device "0.flash"379gitlab # [ 0.811182] Freeing initrd memory: 27184K380gitlab # [ 0.840009] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.849844] thunder_xcv, ver 1.0382gitlab # [ 0.849950] thunder_bgx, ver 1.0383gitlab # [ 0.850003] nicpf, ver 1.0384gitlab # [ 0.852169] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.852180] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.852316] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.852330] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.852397] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.852405] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.852463] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.852479] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.852977] sky2: driver version 1.30393gitlab # [ 0.858440] ehci-pci 0000:00:0a.0: EHCI Host Controller394gitlab # [ 0.858483] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1395gitlab # [ 0.858788] usbcore: registered new interface driver usb-storage396gitlab # [ 0.858795] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000397gitlab # [ 0.859335] usbcore: registered new interface driver usbserial_generic398gitlab # [ 0.859411] usbserial: USB Serial support registered for generic399gitlab # [ 0.861515] hv_vmbus: registering driver hyperv_keyboard400gitlab # [ 0.864478] rtc-pl031 9010000.pl031: registered as rtc0401gitlab # [ 0.864529] rtc-pl031 9010000.pl031: setting system clock to 2026-09-18T22:09:55 UTC (1789769395)402gitlab # [ 0.865618] i2c_dev: i2c /dev entries driver403gitlab # [ 0.869332] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00404gitlab # [ 0.870291] hub 1-0:1.0: USB hub found405gitlab # [ 0.870325] hub 1-0:1.0: 6 ports detected406gitlab # [ 0.875212] sdhci: Secure Digital Host Controller Interface driver407gitlab # [ 0.875228] sdhci: Copyright(c) Pierre Ossman408gitlab # [ 0.876080] Synopsys Designware Multimedia Card Interface Driver409gitlab # [ 0.877238] sdhci-pltfm: SDHCI platform and OF driver helper410gitlab # [ 0.882696] hid: raw HID events driver (C) Jiri Kosina411gitlab # [ 0.883717] usbcore: registered new interface driver usbhid412gitlab # [ 0.883729] usbhid: USB HID core driver413gitlab # [ 0.889987] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.895171] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.895590] NET: Registered PF_INET6 protocol family416gitlab # [ 0.898009] Segment Routing with IPv6417gitlab # [ 0.898057] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.898256] NET: Registered PF_PACKET protocol family419gitlab # [ 0.898581] 9pnet: Installing 9P2000 support420gitlab # [ 0.902628] Key type dns_resolver registered421gitlab # [ 0.920372] registered taskstats version 1422gitlab # [ 0.920856] Loading compiled-in X.509 certificates423gitlab # [ 0.943549] Demotion targets for Node 0: null424gitlab # [ 0.943892] Key type .fscrypt registered425gitlab # [ 0.943902] Key type fscrypt-provisioning registered426gitlab # [ 0.944104] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.944135] ima: Allocated hash algorithm: sha1428gitlab # [ 0.944203] ima: No architecture policies found429gitlab # [ 0.945766] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.989588] clk: Disabling unused clocks431gitlab # [ 0.989661] PM: genpd: Disabling unused power domains432gitlab # [ 1.002418] Freeing unused kernel memory: 4736K433gitlab # [ 1.002794] Run /init as init process434gitlab # [ 1.057621] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 1.121365] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.287294] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.378364] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0438gitlab # [ 1.393431] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)439gitlab # [ 1.393557] systemd[1]: Detected virtualization qemu.440gitlab # [ 1.393721] systemd[1]: Detected architecture arm64.441gitlab # [ 1.393744] systemd[1]: Running in initrd.442gitlab # [ 1.395342] systemd[1]: Initializing machine ID from random generator.443gitlab # [ 1.396136] systemd[1]: Hostname set to <gitlab>.444gitlab # [ 1.497464] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.654061] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2446gitlab # [ 1.654815] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0447gitlab # [ 1.800006] systemd[1]: bpf-restrict-fs: LSM BPF program attached448gitlab # [ 1.956464] systemd[1]: Queued start job for default target Initrd Default Target.449gitlab # [ 1.974925] systemd[1]: Created slice Slice /system/modprobe.450gitlab # [ 1.975462] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.451gitlab # [ 1.975568] systemd[1]: Expecting device /dev/disk/by-label/nix-store...452gitlab # [ 1.975593] systemd[1]: Expecting device /dev/disk/by-label/nixos...453gitlab # [ 1.975682] systemd[1]: Reached target Path Units.454gitlab # [ 1.975782] systemd[1]: Reached target Slice Units.455gitlab # [ 1.975843] systemd[1]: Reached target Swaps.456gitlab # [ 1.975871] systemd[1]: Reached target Timer Units.457gitlab # [ 1.976224] systemd[1]: Listening on D-Bus System Message Bus Socket.458gitlab # [ 1.976697] systemd[1]: Listening on Journal Socket (/dev/log).459gitlab # [ 1.977091] systemd[1]: Listening on Journal Sockets.460gitlab # [ 1.977563] systemd[1]: Listening on udev Control Socket.461gitlab # [ 1.977835] systemd[1]: Listening on udev Kernel Socket.462gitlab # [ 1.977910] systemd[1]: Reached target Socket Units.463gitlab # [ 1.981963] systemd[1]: Starting Create List of Static Device Nodes...464gitlab # [ 1.985515] systemd[1]: Starting Load Kernel Module 9pnet_virtio...465gitlab # [ 1.985681] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs466gitlab # [ 1.993659] systemd[1]: Mounting Kernel Configuration File System...467gitlab # [ 2.022292] systemd[1]: Starting Journal Service...468gitlab # [ 2.029760] systemd[1]: Starting Load Kernel Modules...469gitlab # [ 2.029939] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os470gitlab # [ 2.037517] systemd[1]: Starting Coldplug All udev Devices...471gitlab # [ 2.040955] systemd[1]: Finished Create List of Static Device Nodes.472gitlab # [ 2.042898] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.473gitlab # [ 2.043494] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 2.044015] systemd[1]: Mounted Kernel Configuration File System.475gitlab # [ 2.049003] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...476gitlab # [ 2.091970] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.477gitlab # [ 2.097802] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0478gitlab # [ 2.098016] [drm] features: -virgl +edid -resource_blob -host_visible479gitlab # [ 2.098020] [drm] features: -context_init480gitlab # [ 2.098344] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev481gitlab # [ 2.101068] [drm] number of scanouts: 1482gitlab # [ 2.101083] [drm] number of cap sets: 0483gitlab # [ 2.102748] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.484gitlab # [ 2.105037] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic485gitlab # [ 2.105052] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0486gitlab # [ 2.110632] systemd-journald[95]: Collecting audit messages is disabled.487gitlab # [ 2.114439] Console: switching to colour frame buffer device 160x50488gitlab # [ 2.122430] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device489gitlab # [ 2.125643] systemd[1]: Starting Create Static Device Nodes in /dev...490gitlab # [ 2.164784] systemd-modules-load[96]: Using 4 probe threads491gitlab # [ 2.166073] systemd-modules-load[96]: Module 'virtio_balloon' is built in492gitlab # [ 2.167169] systemd-modules-load[96]: Module 'virtio_console' is built in493gitlab # [ 2.168275] systemd-modules-load[96]: Module 'virtio_rng' is built in[ 2.169921] systemd[1]: Finished Load Kernel Modules.494gitlab # 495gitlab # [ 2.170538] systemd[1]: Started Journal Service.496gitlab # [ 2.172948] systemd-modules-load[96]: Inserted module 'dm_mod'497gitlab # [ 2.174722] systemd-modules-load[96]: Inserted module 'virtio_gpu'498gitlab # [ 2.178296] systemd[1]: Starting Apply Kernel Variables...499gitlab # [ 2.186456] systemd[1]: Finished Create Static Device Nodes in /dev.500gitlab # [ 2.188184] systemd[1]: Reached target Preparation for Local File Systems.501gitlab # [ 2.189177] systemd[1]: Reached target Local File Systems.502gitlab # [ 2.198990] systemd[1]: Starting Create System Files and Directories...503gitlab # [ 2.206429] systemd[1]: Starting Rule-based Manager for Device Events and Files...504gitlab # [ 2.213271] systemd[1]: Finished Apply Kernel Variables.505gitlab # [ 2.236822] systemd[1]: Finished Create System Files and Directories.506gitlab # [ 2.262712] systemd-udevd[114]: Using default interface naming scheme 'v261'.507gitlab # [ 2.293131] systemd[1]: Started Rule-based Manager for Device Events and Files.508gitlab # [ 2.322219] systemd[1]: Starting Virtual Console Setup...509gitlab # [ 2.382252] systemd-vconsole-setup[130]: Configuration of first virtual console was skipped, ignoring remaining ones.510gitlab # [ 2.386743] systemd[1]: Finished Virtual Console Setup.511gitlab # [ 2.687671] systemd[1]: Finished Coldplug All udev Devices.512gitlab # [ 2.688741] systemd[1]: Reached target System Initialization.513gitlab # [ 2.689569] systemd[1]: Reached target Basic System.514gitlab # [ 2.882554] (udev-worker)[138]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.515gitlab # [ 2.891548] (udev-worker)[138]: Network interface NamePolicy= disabled on kernel command line.516gitlab # [ 2.893868] systemd[1]: Found device /dev/disk/by-label/nixos.517gitlab # [ 2.894876] systemd[1]: Reached target Initrd Root Device.518gitlab # [ 2.896650] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...519gitlab # [ 2.913607] (udev-worker)[119]: Network interface NamePolicy= disabled on kernel command line.520gitlab # [ 2.924120] systemd[1]: Found device /dev/disk/by-label/nix-store.521gitlab # [ 2.929932] systemd-fsck[152]: nixos: clean, 12/65536 files, 13019/262144 blocks522gitlab # [ 2.936412] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.523gitlab # [ 3.035897] systemd[1]: Mounting /sysroot...524gitlab # [ 3.084582] EXT4-fs (vda): mounted filesystem d1d3672d-3fe8-4834-9786-717f03f68ca9 r/w with ordered data mode. Quota mode: none.525gitlab # [ 3.083148] systemd[1]: Mounted /sysroot.526gitlab # [ 3.085589] systemd[1]: Reached target Initrd Root File System.527gitlab # [ 3.089334] systemd[1]: Mounting /sysroot/nix/.ro-store...528gitlab # [ 3.091961] systemd[1]: Mounting /sysroot/nix/.rw-store...529gitlab # [ 3.098995] systemd[1]: Mounting /sysroot/run...530gitlab # [ 3.121902] systemd[1]: Mounting /sysroot/tmp/shared...531gitlab # [ 3.123963] systemd[1]: Mounting /sysroot/tmp/xchg...532gitlab # [ 3.139659] systemd[1]: Starting Mountpoints Configured in the Real Root...533gitlab # [ 3.143166] systemd-sysroot-fstab-check[166]: /sysroot should be mounted in the initrd, will request daemon-reload.534gitlab # [ 3.172025] systemd[1]: Mounted /sysroot/nix/.rw-store.535gitlab # [ 3.173843] systemd[1]: Mounted /sysroot/run.536gitlab # [ 3.190307] systemd[1]: Starting rw-sysroot-nix-store.service...537gitlab # [ 3.193661] systemd[1]: Reload requested from client PID 166 ('systemd-sysroot') (unit initrd-parse-etc.service)...538gitlab # [ 3.195485] systemd[1]: Reloading...539gitlab # [ 3.311510] erofs (device vdb): mounted with root inode @ nid 128.540gitlab # [ 3.371536] systemd[1]: Reloading finished in 176 ms.541gitlab # [ 3.432807] systemd-sysroot-fstab-check[166]: Requesting initrd-fs.target/start/replace...542gitlab # [ 3.435378] systemd[1]: Mounted /sysroot/nix/.ro-store.543gitlab # [ 3.436785] systemd[1]: Mounted /sysroot/tmp/shared.544gitlab # [ 3.438565] systemd[1]: Mounted /sysroot/tmp/xchg.545gitlab # [ 3.439352] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.546gitlab # [ 3.440448] systemd[1]: Finished rw-sysroot-nix-store.service.547gitlab # [ 3.442860] systemd-sysroot-fstab-check[166]: Requesting swap.target/start/replace...548gitlab # [ 3.453444] systemd[1]: Starting rw-sysroot-nix-store.service...549gitlab # [ 3.454536] systemd[1]: initrd-parse-etc.service: Deactivated successfully.550gitlab # [ 3.472430] systemd[1]: Finished Mountpoints Configured in the Real Root.551gitlab # [ 3.473868] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.552gitlab # [ 3.479932] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.553gitlab # [ 3.481361] systemd[1]: Finished rw-sysroot-nix-store.service.554gitlab # [ 3.512371] (udev-worker)[137]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory555gitlab # [ 3.516273] (udev-worker)[137]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory556gitlab # [ 3.521776] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.557gitlab # [ 3.523189] systemd[1]: Stopped Virtual Console Setup.558gitlab # [ 3.524034] systemd[1]: Stopping Virtual Console Setup...559gitlab # [ 3.524909] systemd[1]: Starting Virtual Console Setup...560gitlab # [ 3.530865] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.561gitlab # [ 3.531996] systemd[1]: Stopped Virtual Console Setup.562gitlab # [ 3.535613] systemd[1]: Starting Virtual Console Setup...563gitlab # [ 3.577320] systemd-vconsole-setup[200]: Configuration of first virtual console was skipped, ignoring remaining ones.564gitlab # [ 3.579743] systemd[1]: Finished Virtual Console Setup.565gitlab # [ 4.040893] systemd[1]: Mounting /sysroot/nix/store...566gitlab # [ 4.123007] systemd[1]: Mounted /sysroot/nix/store.567gitlab # [ 4.125475] systemd[1]: Reached target Initrd File Systems.568gitlab # [ 4.127915] systemd[1]: Starting Find NixOS closure...569gitlab # [ 4.130866] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...570gitlab # [ 4.178550] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.571gitlab # [ 4.182538] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.572gitlab # [ 4.201729] systemd[1]: Finished Find NixOS closure.573gitlab # [ 4.204188] systemd[1]: Reached target Initrd Default Target.574gitlab # [ 4.206681] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...575gitlab # [ 4.259706] systemd[1]: Stopped target Initrd Default Target.576gitlab # [ 4.262511] systemd[1]: Stopped target Basic System.577gitlab # [ 4.264752] systemd[1]: Stopped target Initrd Root Device.578gitlab # [ 4.267085] systemd[1]: Stopped target Path Units.579gitlab # [ 4.269355] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.580gitlab # [ 4.272574] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.581gitlab # [ 4.275832] systemd[1]: Stopped target Slice Units.582gitlab # [ 4.278098] systemd[1]: Stopped target Socket Units.583gitlab # [ 4.280307] systemd[1]: Stopped target System Initialization.584gitlab # [ 4.282739] systemd[1]: Stopped target Swaps.585gitlab # [ 4.284934] systemd[1]: Stopped target Timer Units.586gitlab # [ 4.288236] systemd[1]: dbus.socket: Deactivated successfully.587gitlab # [ 4.290796] systemd[1]: Closed D-Bus System Message Bus Socket.588gitlab # [ 4.293411] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.589gitlab # [ 4.300797] systemd[1]: Stopped Find NixOS closure.590gitlab # [ 4.303352] systemd[1]: Starting Load Kernel Module 9pnet_virtio...591gitlab # [ 4.306981] systemd[1]: Starting rw-sysroot-nix-store.service...592gitlab # [ 4.309650] systemd[1]: systemd-sysctl.service: Deactivated successfully.593gitlab # [ 4.312469] systemd[1]: Stopped Apply Kernel Variables.594gitlab # [ 4.314651] systemd[1]: systemd-modules-load.service: Deactivated successfully.595gitlab # [ 4.317525] systemd[1]: Stopped Load Kernel Modules.596gitlab # [ 4.319441] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.597gitlab # [ 4.322188] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.598gitlab # [ 4.324744] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.599gitlab # [ 4.326932] systemd[1]: Stopped Create System Files and Directories.600gitlab # [ 4.328855] systemd[1]: Stopped target Local File Systems.601gitlab # [ 4.330420] systemd[1]: Stopped target Preparation for Local File Systems.602gitlab # [ 4.332347] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.603gitlab # [ 4.334225] systemd[1]: Stopped Coldplug All udev Devices.604gitlab # [ 4.335757] systemd[1]: Stopping Rule-based Manager for Device Events and Files...605gitlab # [ 4.337821] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.606gitlab # [ 4.339743] systemd[1]: Stopped Virtual Console Setup.607gitlab # [ 4.341130] systemd[1]: initrd-cleanup.service: Deactivated successfully.608gitlab # [ 4.342699] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.609gitlab # [ 4.344271] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.610gitlab # [ 4.345871] systemd[1]: Finished rw-sysroot-nix-store.service.611gitlab # [ 4.347178] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.612gitlab # [ 4.348849] systemd[1]: Finished Load Kernel Module 9pnet_virtio.613gitlab # [ 4.350323] systemd[1]: systemd-udevd.service: Deactivated successfully.614gitlab # [ 4.351727] systemd[1]: Stopped Rule-based Manager for Device Events and Files.615gitlab # [ 4.353345] systemd[1]: systemd-udevd.service: Consumed 2.338s CPU time over 2.131s wall clock time, 31.5M memory peak.616gitlab # [ 4.355500] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.617gitlab # [ 4.357120] systemd[1]: Closed udev Control Socket.618gitlab # [ 4.358198] systemd[1]: Starting Cleanup udev Database...619gitlab # [ 4.359366] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.620gitlab # [ 4.361061] systemd[1]: Stopped Create Static Device Nodes in /dev.621gitlab # [ 4.363502] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.622gitlab # [ 4.365362] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.623gitlab # [ 4.366888] systemd[1]: kmod-static-nodes.service: Deactivated successfully.624gitlab # [ 4.368593] systemd[1]: Stopped Create List of Static Device Nodes.625gitlab # [ 4.441100] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.626gitlab # [ 4.444385] systemd[1]: Finished Cleanup udev Database.627gitlab # [ 4.446629] systemd[1]: Reached target Switch Root.628gitlab # [ 4.448874] systemd[1]: Starting NixOS Activation...629gitlab # [ 4.632889] initrd-nixos-activation-start[227]: booting system configuration /nix/store/0i15lqnlaw69sr82rxrzb40c710b25vv-nixos-system-gitlab-test630gitlab # [ 4.693391] initrd-nixos-activation-start[227]: running activation script...631gitlab # [ 5.008263] initrd-nixos-activation-start[250]: setting up /etc...632gitlab # [ 5.177047] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.633gitlab # [ 5.180933] systemd[1]: Finished NixOS Activation.634gitlab # [ 5.183087] systemd[1]: Starting Switch Root...635gitlab # [ 5.230315] systemd[1]: Switching root.636gitlab # [ 5.398657] systemd-journald[95]: Received SIGTERM from PID 1 (systemd).637gitlab # [ 6.028177] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)638gitlab # [ 6.028318] systemd[1]: Detected virtualization qemu.639gitlab # [ 6.028401] systemd[1]: Detected architecture arm64.640gitlab # [ 6.028588] systemd[1]: Detected first boot.641gitlab # [ 6.030081] systemd[1]: Initializing machine ID from random generator.642gitlab # [ 6.298683] systemd[1]: bpf-restrict-fs: LSM BPF program attached643gitlab # [ 6.426503] systemd[1]: Applying preset policy.644gitlab # [ 6.666717] systemd[1]: Populated /etc with preset unit settings.645gitlab # [ 6.816668] systemd[1]: initrd-switch-root.service: Deactivated successfully.646gitlab # [ 6.817107] systemd[1]: Stopped initrd-switch-root.service.647gitlab # [ 6.821799] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.648gitlab # [ 6.829377] systemd[1]: Created slice Slice /system/getty.649gitlab # [ 6.832976] systemd[1]: Created slice GitLab DevOps Platform Slice.650gitlab # [ 6.836951] systemd[1]: Created slice User and Session Slice.651gitlab # [ 6.837617] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.652gitlab # [ 6.838287] systemd[1]: Started Forward Password Requests to Wall Directory Watch.653gitlab # [ 6.839500] systemd[1]: Expecting device /dev/hvc0...654gitlab # [ 6.840597] systemd[1]: Expecting device /dev/ttyAMA0...655gitlab # [ 6.841765] systemd[1]: Reached target Local Encrypted Volumes.656gitlab # [ 6.842914] systemd[1]: Stopped target initrd-fs.target.657gitlab # [ 6.844017] systemd[1]: Stopped target initrd-root-fs.target.658gitlab # [ 6.845111] systemd[1]: Stopped target initrd-switch-root.target.659gitlab # [ 6.846368] systemd[1]: Reached target Virtual Machines and Containers.660gitlab # [ 6.847509] systemd[1]: Reached target Path Units.661gitlab # [ 6.848626] systemd[1]: Reached target Remote File Systems.662gitlab # [ 6.849748] systemd[1]: Reached target Slice Units.663gitlab # [ 6.850850] systemd[1]: Reached target Swaps.664gitlab # [ 6.854964] systemd[1]: Listening on Query the User Interactively for a Password.665gitlab # [ 6.859317] systemd[1]: Listening on Process Core Dump Socket.666gitlab # [ 6.862570] systemd[1]: Listening on Credential Encryption/Decryption.667gitlab # [ 6.866281] systemd[1]: Listening on Factory Reset Management.668gitlab # [ 6.867630] systemd[1]: Listening on Hostname Service Socket.669gitlab # [ 6.876227] systemd[1]: Starting Journal Log Access Socket...670gitlab # [ 6.878235] systemd[1]: Listening on Journal Audit Socket.671gitlab # [ 6.881723] systemd[1]: Listening on Console Output Muting Service Socket.672gitlab # [ 6.883001] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.673gitlab # [ 6.883908] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os674gitlab # [ 6.884713] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki675gitlab # [ 6.889188] systemd[1]: Listening on Disk Repartitioning Service Socket.676gitlab # [ 6.890183] systemd[1]: Listening on udev Control Socket.677gitlab # [ 6.891108] systemd[1]: Listening on udev Varlink Socket.678gitlab # [ 6.934131] systemd[1]: Mounting Huge Pages File System...679gitlab # [ 6.939491] systemd[1]: Mounting POSIX Message Queue File System...680gitlab # [ 6.945961] systemd[1]: Mounting Kernel Debug File System...681gitlab # [ 6.953869] systemd[1]: Mounting Kernel Trace File System...682gitlab # [ 6.960172] systemd[1]: Starting Create List of Static Device Nodes...683gitlab # [ 6.969869] systemd[1]: Starting Load Kernel Module 9pnet_virtio...684gitlab # [ 6.971112] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs685gitlab # [ 6.993654] systemd[1]: Mounting Kernel Configuration File System...686gitlab # [ 6.994734] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm687gitlab # [ 6.995708] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore688gitlab # [ 7.007605] systemd[1]: Starting Load Kernel Module fuse...689gitlab # [ 7.010410] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67690gitlab # [ 7.019228] systemd[1]: Starting Journal Service...691gitlab # [ 7.024509] systemd[1]: Starting Load Kernel Modules...692gitlab # [ 7.031944] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...693gitlab # [ 7.037747] fuse: init (API version 7.45)694gitlab # [ 7.045598] systemd[1]: Starting Remount Root and Kernel File Systems...695gitlab # [ 7.048471] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os696gitlab # [ 7.057824] systemd[1]: Starting Coldplug All udev Devices...697gitlab # [ 7.062088] systemd-journald[321]: Collecting audit messages is enabled.698gitlab # [ 7.071189] systemd[1]: Listening on Journal Log Access Socket.699gitlab # [ 7.072838] systemd[1]: Mounted Huge Pages File System.700gitlab # [ 7.077790] systemd[1]: Mounted POSIX Message Queue File System.701gitlab # [ 7.077845] systemd[1]: Queued start job for default target Multi-User System.702gitlab # [ 7.078561] systemd[1]: Mounted Kernel Debug File System.703gitlab # [ 7.079421] systemd[1]: Mounted Kernel Trace File System.704gitlab # [ 7.080628] systemd[1]: Finished Create List of Static Device Nodes.705gitlab # [ 7.084137] systemd[1]: Unnecessary job was removed for /dev/vdb.[ 7.081552] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.706gitlab # 707gitlab # [ 7.084561] systemd[1]: Finished Load Kernel Module 9pnet_virtio.708gitlab # [ 7.085465] systemd[1]: Started Journal Service.709gitlab # [ 7.093696] systemd[1]: systemd-journald.service: Deactivated successfully.[ 7.099148] EXT4-fs (vda): re-mounted d1d3672d-3fe8-4834-9786-717f03f68ca9.710gitlab # 711gitlab # [ 7.101188] systemd-modules-load[322]: Using 3 probe threads712gitlab # [ 7.104158] systemd-modules-load[322]: Module 'atkbd' is built in713gitlab # [ 7.106160] systemd-modules-load[322]: Module 'loop' is built in714gitlab # [ 7.108070] systemd-modules-load[322]: Inserted module 'tls'715gitlab # [ 7.109936] systemd[1]: Mounted Kernel Configuration File System.716gitlab # [ 7.111854] systemd[1]: modprobe@fuse.service: Deactivated successfully.717gitlab # [ 7.113907] systemd[1]: Finished Load Kernel Module fuse.718gitlab # [ 7.115541] systemd[1]: Finished Load Kernel Modules.719gitlab # [ 7.120529] systemd[1]: Mounting FUSE Control File System...720gitlab # [ 7.122370] systemd[1]: Starting Firewall...721gitlab # [ 7.123620] systemd[1]: Starting Apply Kernel Variables...722gitlab # [ 7.125357] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...723gitlab # [ 7.135793] systemd[1]: Finished Remount Root and Kernel File Systems.724gitlab # [ 7.138261] systemd[1]: Mounted FUSE Control File System.725gitlab # [ 7.144982] systemd-oomd[324]: No swap; memory pressure usage will be degraded726gitlab # [ 7.147385] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.727gitlab # [ 7.157567] systemd[1]: Listening on Disk Image Download Service Socket.728gitlab # [ 7.161014] systemd[1]: Starting Flush Journal to Persistent Storage...729gitlab # [ 7.164224] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore730gitlab # [ 7.168512] systemd[1]: Starting Load/Save OS Random Seed...731gitlab # [ 7.170403] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os732gitlab # [ 7.171670] systemd[1]: Finished Apply Kernel Variables.733gitlab # [ 7.192478] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.734gitlab # [ 7.199935] systemd[1]: Starting Create Static Device Nodes in /dev...735gitlab # [ 7.214812] systemd-journald[321]: Received client request to flush runtime journal.736gitlab # [ 7.240454] systemd[1]: Finished Load/Save OS Random Seed.737gitlab # [ 7.241606] systemd[1]: Reached target First Boot Complete.738gitlab # [ 7.242426] systemd[1]: Finished Create Static Device Nodes in /dev.739gitlab # [ 7.243301] systemd[1]: Reached target Preparation for Local File Systems.740gitlab # [ 7.244331] systemd[1]: Starting Rule-based Manager for Device Events and Files...741gitlab # [ 7.249316] systemd[1]: Finished Flush Journal to Persistent Storage.742gitlab # [ 7.315680] systemd-udevd[377]: Using default interface naming scheme 'v261'.743gitlab # [ 7.360867] systemd[1]: Started Rule-based Manager for Device Events and Files.744gitlab # [ 7.456579] systemd[1]: Finished Firewall.745gitlab # [ 7.710030] systemd[1]: Finished Coldplug All udev Devices.746gitlab # [ 7.802733] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs747gitlab # [ 7.816515] systemd[1]: Mounting /run/wrappers...748gitlab # [ 7.884162] systemd[1]: Mounted /run/wrappers.749gitlab # [ 7.889863] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.750gitlab # [ 7.896249] systemd[1]: Reached target Local File Systems.751gitlab # [ 7.897563] systemd[1]: Listening on Boot Loader Control Service Socket.752gitlab # [ 7.900919] systemd[1]: Starting register-nix-paths.service...753gitlab # [ 7.904194] systemd[1]: Starting Create SUID/SGID Wrappers...754gitlab # [ 7.907356] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.755gitlab # [ 7.910073] systemd[1]: Starting Save Transient machine-id to Disk...756gitlab # [ 7.915378] (udev-worker)[444]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.757gitlab # [ 7.918637] (udev-worker)[444]: Network interface NamePolicy= disabled on kernel command line.758gitlab # [ 7.922974] (udev-worker)[477]: Network interface NamePolicy= disabled on kernel command line.759gitlab # [ 7.938071] systemd[1]: Starting Create System Files and Directories...760gitlab # [ 7.944352] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.761gitlab # [ 7.972333] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.762gitlab # [ 7.973662] systemd[1]: Finished Save Transient machine-id to Disk.763gitlab # [ 7.982785] systemd[1]: Finished Create System Files and Directories.764gitlab # [ 7.990710] systemd[1]: Starting Rebuild Journal Catalog...765gitlab # [ 7.999343] systemd[1]: Starting Record System Boot/Shutdown in UTMP...766gitlab # [ 8.000677] systemd[1]: Condition check resulted in Virtio network device being skipped.767gitlab # [ 8.001818] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore768gitlab # [ 8.003373] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.769gitlab # [ 8.005160] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67770gitlab # [ 8.007481] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore771gitlab # [ 8.009338] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os772gitlab # [ 8.010622] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os773gitlab # [ 8.026619] systemd[1]: Finished Record System Boot/Shutdown in UTMP.774gitlab # [ 8.045596] systemd[1]: Finished Rebuild Journal Catalog.775gitlab # [ 8.049256] systemd[1]: Starting Update is Completed...776gitlab # [ 8.055947] mousedev: PS/2 mouse device common for all mice777gitlab # [ 8.101165] systemd[1]: Finished Update is Completed.778gitlab # [ 8.130554] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.779gitlab # [ 8.135513] systemd[1]: Finished Create SUID/SGID Wrappers.780gitlab # [ 8.136590] systemd[1]: suid-sgid-wrappers.service: Consumed 141ms CPU time over 227ms wall clock time, 6.4M memory peak, 1.9M read from disk.781gitlab # [ 8.404407] systemd[1]: Finished register-nix-paths.service.782gitlab # [ 8.405890] systemd[1]: Reached target System Initialization.783gitlab # [ 8.407286] systemd[1]: Started Discard unused filesystem blocks once a week.784gitlab # [ 8.409356] systemd[1]: Started logrotate.timer.785gitlab # [ 8.411491] systemd[1]: Started Daily Cleanup of Temporary Directories.786gitlab # [ 8.412614] systemd[1]: Reached target Timer Units.787gitlab # [ 8.413373] systemd[1]: Listening on D-Bus System Message Bus Socket.788gitlab # [ 8.414302] systemd[1]: Listening on Nix Daemon Socket.789gitlab # [ 8.422325] systemd[1]: Starting nixbot CI service socket...790gitlab # [ 8.423349] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.791gitlab # [ 8.426908] systemd[1]: Starting D-Bus System Message Bus...792gitlab # [ 8.428285] systemd[1]: Listening on nixbot CI service socket.793gitlab # [ 8.429325] systemd[1]: Reached target Socket Units.794gitlab # [ 8.469941] dbus-broker-launch[565]: Looking up NSS user entry for 'systemd-timesync'...795gitlab # [ 8.471671] dbus-broker-launch[565]: NSS returned no entry for 'systemd-timesync'796gitlab # [ 8.474628] dbus-broker-launch[565]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"797gitlab # [ 8.477515] systemd[1]: Started D-Bus System Message Bus.798gitlab # [ 8.488164] dbus-broker-launch[565]: Ready799gitlab # [ 8.489156] systemd[1]: Reached target Basic System.800gitlab # [ 8.516081] systemd[1]: Started backdoor.service.801gitlab # [ 8.520085] systemd[1]: Starting gitlab-config.service...802gitlab # [ 8.528128] systemd[1]: Starting Import lastlog data into lastlog2 database...803gitlab # [ 8.561574] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3804gitlab # connecting to host...805gitlab # [ 8.574267] systemd[1]: Starting Logrotate configuration check...806gitlab: Guest shell says: b'Spawning backdoor root shell...\n'807gitlab: connected to guest root shell808gitlab # [ 8.591676] logrotate[577]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.809gitlab: (connecting took 9.08 seconds)810gitlab: (finished: waiting for the VM to finish booting, in 9.08 seconds)811gitlab # [ 8.593826] logrotate[577]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf812gitlab # [ 8.595176] logrotate[577]: note: 'monthly' overrides previously specified 'weekly'813gitlab # [ 8.596240] logrotate[577]: Reading state from file: /var/lib/logrotate.status814gitlab # [ 8.597283] logrotate[577]: state file /var/lib/logrotate.status does not exist815gitlab # [ 8.600920] logrotate[577]: Allocating hash table for state file, size 64 entries816gitlab # [ 8.602033] logrotate[577]: Handling 4 logs817gitlab # [ 8.602694] logrotate[577]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed818gitlab # [ 8.604903] logrotate[577]: considering log /var/log/btmp819gitlab # [ 8.605738] logrotate[577]: Creating new state820gitlab # [ 8.606352] logrotate[577]: Now: 2026-09-18 22:10821gitlab # [ 8.607125] logrotate[577]: Last rotated at 2026-09-18 22:00822gitlab # [ 8.608001] logrotate[577]: log does not need rotating (log has already been rotated)823gitlab # [ 8.611164] logrotate[577]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed824gitlab # [ 8.613582] logrotate[577]: considering log /var/log/wtmp825gitlab # [ 8.614928] logrotate[577]: Creating new state826gitlab # [ 8.616741] logrotate[577]: Now: 2026-09-18 22:10827gitlab # [ 8.617405] logrotate[577]: Last rotated at 2026-09-18 22:00828gitlab # [ 8.618155] logrotate[577]: log does not need rotating (log has already been rotated)829gitlab # [ 8.619156] logrotate[577]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed830gitlab # [ 8.621025] logrotate[577]: switching euid from 0 to 165 and egid from 0 to 165 (pid 577)831gitlab # [ 8.622100] logrotate[577]: considering log /var/gitlab/state/log/*.log832gitlab # [ 8.622953] logrotate[577]: log /var/gitlab/state/log/*.log does not exist -- skipping833gitlab # [ 8.623976] logrotate[577]: Creating new state834gitlab # [ 8.624699] logrotate[577]: switching euid from 165 to 0 and egid from 165 to 0 (pid 577)835gitlab # [ 8.625770] logrotate[577]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed836gitlab # [ 8.627363] logrotate[577]: switching euid from 0 to 60 and egid from 0 to 60 (pid 577)837gitlab # [ 8.628410] logrotate[577]: considering log /var/log/nginx/*.log838gitlab # [ 8.629181] logrotate[577]: log /var/log/nginx/*.log does not exist -- skipping839gitlab # [ 8.630121] logrotate[577]: Creating new state840gitlab # [ 8.630748] logrotate[577]: not running postrotate script, since no logs were rotated841gitlab # [ 8.631739] logrotate[577]: switching euid from 60 to 0 and egid from 60 to 0 (pid 577)842gitlab # [ 8.633258] systemd[1]: Starting Name Service Cache Daemon (nsncd)...843gitlab # [ 8.634400] systemd[1]: Starting Post-Boot Actions...844gitlab # [ 8.640173] systemd[1]: Started Reset console on configuration changes.845gitlab # [ 8.641411] systemd[1]: Starting resolvconf update...846gitlab # [ 8.647359] systemd[1]: Started Name Service Cache Daemon (nsncd).847gitlab # [ 8.648721] nsncd[584]: Sep 18 22:10:03.288 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"848gitlab # [ 8.658911] systemd[1]: Finished Logrotate configuration check.849gitlab # [ 8.659819] systemd[1]: Finished Post-Boot Actions.850gitlab # [ 8.666302] systemd[1]: Finished Import lastlog data into lastlog2 database.851gitlab # [ 8.685940] systemd[1]: Reached target Host and Network Name Lookups.852gitlab # [ 8.686967] systemd[1]: Reached target User and Group Name Lookups.853gitlab # [ 8.692379] systemd[1]: Starting User Login Management...854gitlab # [ 8.696816] systemd[1]: Starting Virtual Console Setup...855gitlab # [ 8.723781] systemd[1]: Stopped target Host and Network Name Lookups.856gitlab # [ 8.724842] systemd[1]: Stopping Host and Network Name Lookups...857gitlab # [ 8.726781] systemd[1]: Stopped target User and Group Name Lookups.858gitlab # [ 8.728766] systemd[1]: Stopping User and Group Name Lookups...859gitlab # [ 8.729791] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...860gitlab # [ 8.732418] systemd[1]: nscd.service: Deactivated successfully.861gitlab # [ 8.733655] systemd[1]: Stopped Name Service Cache Daemon (nsncd).862gitlab # [ 8.735830] systemd[1]: nscd.service: Consumed 23ms CPU time over 120ms wall clock time, 7.6M memory peak, 5.8M read from disk.863gitlab # [ 8.738324] systemd[1]: Starting Name Service Cache Daemon (nsncd)...864gitlab # [ 8.753474] systemd[1]: Started Name Service Cache Daemon (nsncd).865gitlab # [ 8.754716] systemd[1]: Reached target Host and Network Name Lookups.866gitlab # [ 8.755856] systemd[1]: Reached target User and Group Name Lookups.867gitlab # [ 8.758439] nsncd[664]: Sep 18 22:10:03.397 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"868gitlab # [ 8.770436] systemd[1]: Finished resolvconf update.869gitlab # [ 8.771273] systemd[1]: Reached target Preparation for Network.870gitlab # [ 8.775340] systemd-logind[627]: New seat seat0.871gitlab # [ 8.777904] systemd[1]: Starting DHCP Client...872gitlab # [ 8.778572] systemd-logind[627]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)873gitlab # [ 8.779742] systemd-logind[627]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)874gitlab # [ 8.784431] systemd-logind[627]: Watching system buttons on /dev/input/event0 (gpio-keys)875gitlab # [ 8.787362] systemd[1]: Starting Address configuration of eth1...876gitlab # [ 8.789219] systemd-vconsole-setup[631]: Configuration of first virtual console was skipped, ignoring remaining ones.877gitlab # [ 8.790861] systemd[1]: Starting Extra networking commands....878gitlab # [ 8.791712] systemd[1]: Started User Login Management.879gitlab # [ 8.806582] systemd[1]: Finished Virtual Console Setup.880gitlab # [ 8.811605] systemd[1]: Starting linger-users.service...881gitlab # [ 8.839089] systemd[1]: linger-users.service: Deactivated successfully.882gitlab # [ 8.840735] network-addresses-eth1-start[692]: adding address 192.168.1.1/24... done883gitlab # [ 8.841820] systemd[1]: Finished linger-users.service.884gitlab # [ 8.842865] network-addresses-eth1-start[692]: adding address 2001:db8:1::1/64... done885gitlab # [ 8.860387] systemd[1]: Finished Address configuration of eth1.886gitlab # [ 8.888488] systemd[1]: Finished Extra networking commands..887gitlab # [ 8.890085] systemd[1]: Reached target Network.888gitlab # [ 8.892476] systemd[1]: Starting gitlab-workhorse.service...889gitlab # [ 8.895711] systemd[1]: Starting Nginx Web Server...890gitlab # [ 8.898886] systemd[1]: Starting PostgreSQL Server...891gitlab # [ 8.900343] dhcpcd[716]: dhcpcd-10.3.2 starting892gitlab # [ 8.902448] dhcpcd[764]: dev: loaded udev893gitlab # [ 8.909382] systemd[1]: Starting Redis Server - redis-gitlab...894gitlab # [ 8.919025] 8021q: 802.1Q VLAN Support v1.8895gitlab # [ 8.919455] 8021q: adding VLAN 0 to HW filter on device eth1896gitlab # [ 8.916119] systemd[1]: Starting Permit User Sessions...897gitlab # [ 8.927679] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.898gitlab # [ 8.947524] systemd[1]: Finished Permit User Sessions.899gitlab # [ 8.952427] systemd[1]: Started Getty on tty1.900gitlab # [ 8.957008] systemd[1]: Reached target Login Prompts.901gitlab # [ 8.966245] cfg80211: Loading compiled-in X.509 certificates for regulatory database902gitlab # [ 8.978342] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'903gitlab # [ 8.978858] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'904gitlab # [ 8.980564] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2905gitlab # [ 8.980885] cfg80211: failed to load regulatory.db906gitlab # [ 9.012912] 8021q: adding VLAN 0 to HW filter on device eth0907gitlab # [ 9.009429] dhcpcd[764]: eth0: waiting for carrier908gitlab # [ 9.010445] dhcpcd[764]: eth0: carrier acquired909gitlab # [ 9.020538] dhcpcd[764]: DUID 00:01:00:01:32:40:73:3b:52:54:00:12:34:56910gitlab # [ 9.021634] dhcpcd[764]: eth0: IAID 00:12:34:56911gitlab # [ 9.022389] dhcpcd[764]: eth0: adding address fe80::5054:ff:fe12:3456912gitlab # [ 9.071959] nginx-pre-start[793]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok913gitlab # [ 9.074147] nginx-pre-start[793]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful914gitlab # [ 9.081628] systemd[1]: Started Nginx Web Server.915gitlab # [ 9.091966] redis-server[789]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.916gitlab # [ 9.094523] redis-server[789]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo917gitlab # [ 9.095980] redis-server[789]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=789, just started918gitlab # [ 9.098053] redis-server[789]: Configuration loaded919gitlab # [ 9.098903] systemd[1]: Started Redis Server - redis-gitlab.920gitlab # [ 9.099842] redis[789]: monotonic clock: ARM CNTVCT @ 1000 ticks/us921gitlab # [ 9.101010] redis[789]: Running mode=standalone, port=0.922gitlab # [ 9.101966] redis[789]: Server initialized923gitlab # [ 9.102731] redis[789]: Ready to accept connections unix924gitlab # [ 9.103730] redis[789]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.925gitlab # [ 9.114815] postgresql-pre-start[795]: The files belonging to this database system will be owned by user "postgres".926gitlab # [ 9.116901] postgresql-pre-start[795]: This user must also own the server process.927gitlab # [ 9.117943] postgresql-pre-start[795]: The database cluster will be initialized with locale "en_US.UTF-8".928gitlab # [ 9.119260] postgresql-pre-start[795]: The default database encoding has accordingly been set to "UTF8".929gitlab # [ 9.120625] postgresql-pre-start[795]: The default text search configuration will be set to "english".930gitlab # [ 9.122079] postgresql-pre-start[795]: Data page checksums are enabled.931gitlab # [ 9.123000] postgresql-pre-start[795]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok932gitlab # [ 9.124268] postgresql-pre-start[795]: creating subdirectories ... ok933gitlab # [ 9.125299] dhcpcd[764]: eth0: soliciting a DHCP lease934gitlab # [ 9.126085] postgresql-pre-start[795]: selecting dynamic shared memory implementation ... posix935gitlab # [ 9.128681] dhcpcd[764]: eth0: offered 10.0.2.15 from 10.0.2.2936gitlab # [ 9.152291] dhcpcd[764]: eth0: probing address 10.0.2.15/24937gitlab # [ 9.157921] postgresql-pre-start[795]: selecting default "max_connections" ... 100938gitlab # [ 9.223314] postgresql-pre-start[795]: selecting default "shared_buffers" ... 128MB939gitlab # [ 9.553334] systemd[1]: Started gitlab-workhorse.service.940gitlab # [ 9.728422] postgresql-pre-start[795]: selecting default time zone ... UTC941gitlab # [ 9.730410] postgresql-pre-start[795]: creating configuration files ... ok942gitlab # [ 9.848910] gitlab-workhorse[822]: time="2026-09-18T22:10:04Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4943gitlab # [ 9.850610] gitlab-workhorse[822]: time="2026-09-18T22:10:04Z" level=info msg="Using redis/go-redis"944gitlab # [ 9.856115] gitlab-workhorse[822]: time="2026-09-18T22:10:04Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix945gitlab # [ 9.968095] postgresql-pre-start[795]: running bootstrap script ... ok946gitlab # [ 10.334754] dhcpcd[764]: eth0: soliciting an IPv6 router947gitlab # [ 10.337097] dhcpcd[764]: eth0: Router Advertisement from fe80::2948gitlab # [ 10.339094] dhcpcd[764]: eth0: adding address fec0::5054:ff:fe12:3456/64949gitlab # [ 10.341268] dhcpcd[764]: eth0: adding route to fec0::/64950gitlab # [ 10.343045] dhcpcd[764]: eth0: adding default route via fe80::2951gitlab # [ 10.700196] postgresql-pre-start[795]: performing post-bootstrap initialization ... ok952gitlab # [ 10.987771] postgresql-pre-start[795]: syncing data to disk ... ok953gitlab # [ 10.990878] postgresql-pre-start[795]: initdb: warning: enabling "trust" authentication for local connections954gitlab # [ 10.995180] postgresql-pre-start[795]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.955gitlab # [ 11.001905] postgresql-pre-start[795]: Success. You can now start the database server using:956gitlab # [ 11.005570] postgresql-pre-start[795]: pg_ctl -D /var/lib/postgresql/18 -l logfile start957gitlab # [ 11.122691] postgres[856]: [856] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit958gitlab # [ 11.128376] postgres[856]: [856] LOG: listening on IPv6 address "::1", port 5432959gitlab # [ 11.131542] postgres[856]: [856] LOG: listening on IPv4 address "127.0.0.1", port 5432960gitlab # [ 11.136268] postgres[856]: [856] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"961gitlab # [ 11.144821] postgres[865]: [865] LOG: database system was shut down at 2026-09-18 22:10:05 GMT962gitlab # [ 11.154664] postgres[856]: [856] LOG: database system is ready to accept connections963gitlab # [ 11.159741] systemd[1]: Started PostgreSQL Server.964gitlab # [ 11.164949] systemd[1]: Starting PostgreSQL Setup Scripts...965gitlab # [ 11.507007] postgresql-setup-start[876]: CREATE DATABASE966gitlab # [ 11.550103] postgresql-setup-start[891]: CREATE ROLE967gitlab # [ 11.567949] postgresql-setup-start[893]: ALTER DATABASE968gitlab # [ 11.617718] postgresql-setup-start[898]: CREATE ROLE969gitlab # [ 11.622588] systemd[1]: Finished PostgreSQL Setup Scripts.970gitlab # [ 11.625687] systemd[1]: Reached target PostgreSQL.971gitlab # [ 11.628117] systemd[1]: Starting gitlab-postgresql.service...972gitlab # [ 11.665492] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[881]: mkdir -p /var/gitlab/state/home/.ssh: OK973gitlab # [ 11.669710] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[881]: chmod 700 /var/gitlab/state/home/.ssh: OK974gitlab # [ 11.776181] systemd[1]: Finished gitlab-config.service.975gitlab # [ 11.783031] systemd[1]: Started gitaly.service.976gitlab # [ 11.788452] systemd[1]: Starting gitlab-db-config.service...977gitlab # [ 11.804176] gitlab-postgresql-start[911]: CREATE DATABASE978gitlab # [ 11.884887] gitlab-postgresql-start[930]: CREATE EXTENSION979gitlab # [ 11.973052] gitlab-postgresql-start[937]: CREATE EXTENSION980gitlab # [ 11.980955] systemd[1]: Finished gitlab-postgresql.service.981gitlab # [ 12.522745] gitaly[920]: time="2026-09-18T22:10:07.162Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=920982gitlab # [ 12.536473] gitaly[920]: time="2026-09-18T22:10:07.162Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=920983gitlab # [ 12.541077] gitaly[920]: time="2026-09-18T22:10:07.162Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=920984gitlab # [ 12.550415] gitaly[920]: time="2026-09-18T22:10:07.162Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=920985gitlab # [ 12.555474] gitaly[920]: time="2026-09-18T22:10:07.162Z" level=info msg="Starting Gitaly" pid=920 version=986gitlab # [ 12.749646] gitaly[920]: time="2026-09-18T22:10:07.390Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=226 pid=920987gitlab # [ 12.751881] gitaly[920]: time="2026-09-18T22:10:07.390Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=920988gitlab # [ 12.754121] gitaly[920]: time="2026-09-18T22:10:07.390Z" level=info msg="finished initializing command factory" duration_ms=0 pid=920989gitlab # [ 12.756014] gitaly[920]: time="2026-09-18T22:10:07.390Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-920/git-exec-298627402.d/git pid=920990gitlab # [ 12.758432] gitaly[920]: time="2026-09-18T22:10:07.396Z" level=info msg="finished detecting git version" duration_ms=5 pid=920991gitlab # [ 12.760251] gitaly[920]: time="2026-09-18T22:10:07.396Z" level=info msg="using Git version" pid=920 version=2.53.g992gitlab # [ 12.761703] gitaly[920]: time="2026-09-18T22:10:07.396Z" level=info msg="clearing disk cache object folder" pid=920 storage=default993gitlab # [ 12.763216] gitaly[920]: time="2026-09-18T22:10:07.396Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4209479730 pid=920 storage=default994gitlab # [ 12.765629] gitaly[920]: time="2026-09-18T22:10:07.396Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4209479730 pid=920 storage=default995gitlab # [ 12.769232] gitaly[920]: time="2026-09-18T22:10:07.396Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=920996gitlab # [ 12.772835] gitaly[920]: time="2026-09-18T22:10:07.396Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=920997gitlab # [ 12.777689] gitaly[920]: time="2026-09-18T22:10:07.397Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4209479730 clear_duration_ms=0 pid=920 storage=default998gitlab # [ 12.781126] gitaly[920]: time="2026-09-18T22:10:07.418Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=920999gitlab # [ 12.783857] gitaly[920]: time="2026-09-18T22:10:07.419Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=920 schema=unix1000gitlab # [ 12.786894] gitaly[920]: time="2026-09-18T22:10:07.419Z" level=info msg="listening at address" address=/run/gitaly/gitaly-920/sock.d/intern pid=920 schema=unix1001gitlab # [ 12.789519] gitaly[920]: time="2026-09-18T22:10:07.419Z" level=info msg="counting repositories" pid=9201002gitlab # [ 12.791245] gitaly[920]: time="2026-09-18T22:10:07.419Z" level=info msg="starting to count repositories" pid=920 storage_path=/var/gitlab/state/repositories1003gitlab # [ 12.793858] gitaly[920]: time="2026-09-18T22:10:07.419Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=920 storage_path=/var/gitlab/state/repositories1004gitlab # [ 12.795963] gitaly[920]: time="2026-09-18T22:10:07.419Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9201005gitlab # [ 12.798101] gitaly[920]: time="2026-09-18T22:10:07.419Z" level=info msg="finished tempdir cleaner walk" pid=920 storage=default time_ms=01006gitlab # [ 12.800163] gitaly[920]: time="2026-09-18T22:10:07.421Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9201007gitlab # [ 12.802416] gitaly[920]: time="2026-09-18T22:10:07.421Z" level=info msg="Started Gitaly" duration_ms=258 pid=9201008gitlab # [ 12.804266] gitaly[920]: time="2026-09-18T22:10:07.421Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9201009gitlab # [ 12.806362] gitaly[920]: time="2026-09-18T22:10:07.421Z" level=info msg="maintenance: daily scheduled" pid=920 scheduled="2026-09-19 12:00:00 +0000 UTC"1010gitlab # [ 13.103489] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[924]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1011gitlab # [ 13.113592] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[924]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1012gitlab # [ 13.123258] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[924]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1013gitlab # [ 14.326954] dhcpcd[764]: eth0: leased 10.0.2.15 for 86400 seconds1014gitlab # [ 14.327322] dhcpcd[764]: eth0: adding route to 10.0.2.0/241015gitlab # [ 14.327551] dhcpcd[764]: eth0: adding default route via 10.0.2.21016gitlab # [ 14.449969] systemd[1]: Started DHCP Client.1017gitlab # [ 14.451549] systemd[1]: Reached target Network is Online.1018gitlab # [ 16.238666] gitaly[920]: time="2026-09-18T22:10:10.878Z" level=info msg="License database preloaded" duration_ms=3714 pid=9201019gitlab # [ 59.256711] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[924]: W, [2026-09-18T22:10:53.895494 #924] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1020gitlab # [ 59.914343] gitlab-workhorse[822]: time="2026-09-18T22:10:54Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1021gitlab # [ 62.179202] postgres[1448]: [1448] ERROR: relation "feature_gates" does not exist at character 5231022gitlab # [ 62.179668] postgres[1448]: [1448] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1023gitlab # [ 62.179801] postgres[1448]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1024gitlab # [ 62.179925] postgres[1448]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1025gitlab # [ 62.194015] postgres[1448]: attidentity AS identity,1026gitlab # [ 62.196438] postgres[1448]: attgenerated as attgenerated1027gitlab # [ 62.198864] postgres[1448]: FROM pg_attribute a1028gitlab # [ 62.200964] postgres[1448]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1029gitlab # [ 62.204686] postgres[1448]: LEFT JOIN pg_type t ON a.atttypid = t.oid1030gitlab # [ 62.207392] postgres[1448]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1031gitlab # [ 62.211653] postgres[1448]: WHERE a.attrelid = '"feature_gates"'::regclass1032gitlab # [ 62.214498] postgres[1448]: AND a.attnum > 0 AND NOT a.attisdropped1033gitlab # [ 62.217281] postgres[1448]: ORDER BY a.attnum1034gitlab # [ 62.219180] postgres[1448]:1035gitlab # [ 67.453217] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1499]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1036gitlab # [ 67.453644] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1499]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1037gitlab # [ 69.922534] gitlab-workhorse[822]: time="2026-09-18T22:11:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1038gitlab # [ 79.933247] gitlab-workhorse[822]: time="2026-09-18T22:11:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1039gitlab # [ 89.942624] gitlab-workhorse[822]: time="2026-09-18T22:11:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1040gitlab # [ 94.286595] postgres[1611]: [1611] ERROR: relation "table_without_models" does not exist1041gitlab # [ 94.287085] postgres[1611]: [1611] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1042gitlab # [ 99.943745] gitlab-workhorse[822]: time="2026-09-18T22:11:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1043gitlab # [ 109.954102] gitlab-workhorse[822]: time="2026-09-18T22:11:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1044gitlab # [ 119.955334] gitlab-workhorse[822]: time="2026-09-18T22:11:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1045gitlab # [ 124.909324] systemd[1]: Finished gitlab-db-config.service.1046gitlab # [ 124.913993] systemd[1]: Started gitlab-sidekiq.service.1047gitlab # [ 124.917727] systemd[1]: Starting gitlab.service...1048gitlab # [ 125.618344] bundle[1986]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1049gitlab # [ 125.624979] bundle[1986]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1050gitlab # [ 125.631597] bundle[1986]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1051gitlab # [ 129.960599] gitlab-workhorse[822]: time="2026-09-18T22:12:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1052gitlab # [ 131.092435] sidekiq-cluster[1985]: {"severity":"INFO","time":"2026-09-18T22:12:05.691Z","message":"Starting cluster with 1 processes"}1053gitlab # [ 131.199184] bundle[1986]: {"timestamp":"2026-09-18T22:12:05.796Z","pid":1986,"message":"* Enabling systemd notification integration"}1054gitlab # [ 131.200916] bundle[1986]: {"timestamp":"2026-09-18T22:12:05.839Z","pid":1986,"message":"Puma starting in cluster mode..."}1055gitlab # [ 131.202289] bundle[1986]: {"timestamp":"2026-09-18T22:12:05.839Z","pid":1986,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1056gitlab # [ 131.203786] bundle[1986]: {"timestamp":"2026-09-18T22:12:05.839Z","pid":1986,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1057gitlab # [ 131.205877] bundle[1986]: {"timestamp":"2026-09-18T22:12:05.839Z","pid":1986,"message":"* Min threads: 0"}1058gitlab # [ 131.207126] bundle[1986]: {"timestamp":"2026-09-18T22:12:05.839Z","pid":1986,"message":"* Max threads: 4"}1059gitlab # [ 131.208449] bundle[1986]: {"timestamp":"2026-09-18T22:12:05.839Z","pid":1986,"message":"* Environment: production"}1060gitlab # [ 131.209755] bundle[1986]: {"timestamp":"2026-09-18T22:12:05.839Z","pid":1986,"message":"* Master PID: 1986"}1061gitlab # [ 131.211077] bundle[1986]: {"timestamp":"2026-09-18T22:12:05.839Z","pid":1986,"message":"* Workers: 2"}1062gitlab # [ 131.212329] bundle[1986]: {"timestamp":"2026-09-18T22:12:05.839Z","pid":1986,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1063gitlab # [ 131.213886] bundle[1986]: {"timestamp":"2026-09-18T22:12:05.839Z","pid":1986,"message":"* Preloading application"}1064gitlab # [ 139.961860] gitlab-workhorse[822]: time="2026-09-18T22:12:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1065gitlab # [ 149.963866] gitlab-workhorse[822]: time="2026-09-18T22:12:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1066gitlab # [ 159.974254] gitlab-workhorse[822]: time="2026-09-18T22:12:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1067gitlab # [ 169.982377] gitlab-workhorse[822]: time="2026-09-18T22:12:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1068gitlab # [ 174.441661] bundle[1986]: W, [2026-09-18T22:12:49.081042 #1986] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1069gitlab # [ 179.983517] gitlab-workhorse[822]: time="2026-09-18T22:12:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1070gitlab # [ 180.886825] sidekiq-cluster[2038]: 2026-09-18T22:12:55.526Z pid=2038 tid=wny INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2038, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>428171264}1071gitlab # [ 181.168621] sidekiq-cluster[2038]: W, [2026-09-18T22:12:55.808930 #2038] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1072gitlab # [ 181.317477] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:55.957Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1073gitlab # [ 184.707435] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.346Z","message":"GitLab reliable fetch activated!"}1074gitlab # [ 184.707815] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.347Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1075gitlab # [ 184.740425] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.380Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1076gitlab # [ 184.747321] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.384Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1077gitlab # [ 184.754427] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.386Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1078gitlab # [ 184.761089] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.389Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1079gitlab # [ 184.768447] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.392Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1080gitlab # [ 184.775030] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.395Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1081gitlab # [ 184.781052] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.397Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1082gitlab # [ 184.785870] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.399Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1083gitlab # [ 184.790356] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.401Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1084gitlab # [ 184.794619] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.403Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1085gitlab # [ 184.799145] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.405Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1086gitlab # [ 184.803221] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.408Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1087gitlab # [ 184.806827] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.410Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1088gitlab # [ 184.810464] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.412Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1089gitlab # [ 184.813877] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.415Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1090gitlab # [ 184.818122] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.417Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1091gitlab # [ 184.821059] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.421Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1092gitlab # [ 184.823754] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.424Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1093gitlab # [ 184.826863] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.428Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1094gitlab # [ 184.829665] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.431Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1095gitlab # [ 184.832667] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.434Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1096gitlab # [ 184.835614] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.437Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1097gitlab # [ 184.838329] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.439Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1098gitlab # [ 184.840921] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.442Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1099gitlab # [ 184.843418] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.445Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1100gitlab # [ 184.845855] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.448Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1101gitlab # [ 184.848053] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.451Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1102gitlab # [ 184.850259] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.454Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1103gitlab # [ 184.852546] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.457Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1104gitlab # [ 184.854839] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.464Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1105gitlab # [ 184.857061] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.470Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1106gitlab # [ 184.859407] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.477Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1107gitlab # [ 184.861584] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.484Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1108gitlab # [ 184.863779] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.489Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1109gitlab # [ 184.866287] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.495Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1110gitlab # [ 184.868381] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.499Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1111gitlab # [ 184.870426] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.503Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1112gitlab # [ 184.872416] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.507Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1113gitlab # [ 184.874404] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.510Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1114gitlab # [ 184.876539] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.513Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1115gitlab # [ 184.878688] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.517Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1116gitlab # [ 184.880859] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.520Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1117gitlab # [ 184.883004] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.523Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1118gitlab # [ 184.886225] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.526Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1119gitlab # [ 184.889602] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.530Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1120gitlab # [ 184.892381] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.533Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1121gitlab # [ 184.894886] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.535Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1122gitlab # [ 184.897611] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.538Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1123gitlab # [ 184.900736] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.541Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1124gitlab # [ 184.903669] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.544Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1125gitlab # [ 184.906613] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.547Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1126gitlab # [ 184.909683] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.550Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1127gitlab # [ 184.923583] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.564Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1128gitlab # [ 184.927871] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.567Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1129gitlab # [ 184.931426] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.569Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1130gitlab # [ 184.934907] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.572Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1131gitlab # [ 185.011016] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.651Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1132gitlab # [ 185.016309] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.654Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1133gitlab # [ 185.021093] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.656Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1134gitlab # [ 185.026030] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.660Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1135gitlab # [ 185.030532] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.663Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1136gitlab # [ 185.035059] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.666Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1137gitlab # [ 185.039840] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.669Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1138gitlab # [ 185.044764] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.673Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1139gitlab # [ 185.049615] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.676Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1140gitlab # [ 185.054155] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.680Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1141gitlab # [ 185.058258] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.682Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1142gitlab # [ 185.062316] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.685Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1143gitlab # [ 185.066330] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.687Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1144gitlab # [ 185.070121] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.690Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1145gitlab # [ 185.073623] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.692Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1146gitlab # [ 185.076978] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.695Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1147gitlab # [ 185.080212] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.697Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1148gitlab # [ 185.083458] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.699Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1149gitlab # [ 185.086744] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.702Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1150gitlab # [ 185.090880] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.704Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1151gitlab # [ 185.093696] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.706Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1152gitlab # [ 185.096796] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.708Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1153gitlab # [ 185.099479] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.711Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1154gitlab # [ 185.102232] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.713Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1155gitlab # [ 185.105207] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.716Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1156gitlab # [ 185.108181] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.718Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1157gitlab # [ 185.110991] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.721Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1158gitlab # [ 185.113811] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.724Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1159gitlab # [ 185.116715] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.726Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1160gitlab # [ 185.119361] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.729Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1161gitlab # [ 185.122341] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.732Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1162gitlab # [ 185.125301] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.734Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1163gitlab # [ 185.128141] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.736Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1164gitlab # [ 185.130937] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.739Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1165gitlab # [ 185.133946] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.741Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1166gitlab # [ 185.136801] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.743Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1167gitlab # [ 185.139670] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.745Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1168gitlab # [ 185.142898] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.747Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1169gitlab # [ 185.145379] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.751Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1170gitlab # [ 185.148176] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.754Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1171gitlab # [ 185.150765] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.756Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1172gitlab # [ 185.153346] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.758Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1173gitlab # [ 185.155784] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.777Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1174gitlab # [ 185.158413] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.780Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1175gitlab # [ 185.160848] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.782Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1176gitlab # [ 185.163250] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.788Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1177gitlab # [ 185.165529] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.793Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1178gitlab # [ 185.167752] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.796Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1179gitlab # [ 185.170298] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.799Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1180gitlab # [ 185.172686] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.802Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1181gitlab # [ 185.174776] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.805Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1182gitlab # [ 185.177084] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.808Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1183gitlab # [ 185.179262] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:12:59.811Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1184gitlab # [ 189.984840] gitlab-workhorse[822]: time="2026-09-18T22:13:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1185gitlab # [ 199.985745] gitlab-workhorse[822]: time="2026-09-18T22:13:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1186gitlab # [ 209.994928] gitlab-workhorse[822]: time="2026-09-18T22:13:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1187gitlab # [ 220.006282] gitlab-workhorse[822]: time="2026-09-18T22:13:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1188gitlab # [ 224.062005] postgres[2827]: [2827] ERROR: relation "table_without_models" does not exist1189gitlab # [ 224.065362] postgres[2827]: [2827] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1190gitlab # [ 227.289756] postgres[2847]: [2847] ERROR: relation "table_without_models" does not exist1191gitlab # [ 227.290146] postgres[2847]: [2847] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1192gitlab # [ 227.345778] sidekiq-cluster[2038]: InitializerConnections Query: SET client_min_messages TO 'warning'1193gitlab # [ 227.347093] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1194gitlab # [ 227.349710] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1195gitlab # [ 227.350942] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1196gitlab # [ 227.352291] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1197gitlab # [ 227.353458] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'1198gitlab # [ 227.354640] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1199gitlab # [ 227.356135] sidekiq-cluster[2038]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1200gitlab # [ 227.404679] sidekiq-cluster[2038]: InitializerConnections Query: SET standard_conforming_strings = on1201gitlab # [ 227.407043] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1202gitlab # [ 227.409423] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1203gitlab # [ 227.411408] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1204gitlab # [ 227.413664] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1205gitlab # [ 227.415569] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'1206gitlab # [ 227.417580] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1207gitlab # [ 227.420043] sidekiq-cluster[2038]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1208gitlab # [ 227.422576] sidekiq-cluster[2038]: InitializerConnections Query: SET intervalstyle = iso_86011209gitlab # [ 227.424320] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1210gitlab # [ 227.426449] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1211gitlab # [ 227.428259] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1212gitlab # [ 227.430167] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1213gitlab # [ 227.431825] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'1214gitlab # [ 227.433589] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1215gitlab # [ 227.435633] sidekiq-cluster[2038]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1216gitlab # [ 227.508538] sidekiq-cluster[2038]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT t.oid, t.typname1217gitlab # [ 227.512591] sidekiq-cluster[2038]: FROM pg_type as t1218gitlab # [ 227.514085] sidekiq-cluster[2038]: WHERE t.typname IN ('int2', 'int4', 'int8', 'oid', 'float4', 'float8', 'numeric', 'bool', 'timestamp', 'timestamptz')1219gitlab # [ 227.517882] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1220gitlab # [ 227.520996] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1221gitlab # [ 227.523641] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1222gitlab # [ 227.526630] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1223gitlab # [ 227.529254] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'1224gitlab # [ 227.531827] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1225gitlab # [ 227.535246] sidekiq-cluster[2038]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1226gitlab # [ 227.538887] sidekiq-cluster[2038]: InitializerConnections Query: SET SESSION timezone TO 'UTC'1227gitlab # [ 227.541369] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1228gitlab # [ 227.544491] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1229gitlab # [ 227.547078] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1230gitlab # [ 227.549821] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1231gitlab # [ 227.552111] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'1232gitlab # [ 227.554359] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1233gitlab # [ 227.558234] sidekiq-cluster[2038]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1234gitlab # [ 227.615703] sidekiq-cluster[2038]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT "feature_gates"."key", "feature_gates"."value" FROM "feature_gates" WHERE "feature_gates"."feature_key" = 'sidekiq_throttling_middleware'1235gitlab # [ 227.624106] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1236gitlab # [ 227.627692] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1237gitlab # [ 227.636256] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1238gitlab # [ 227.639687] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1239gitlab # [ 227.642806] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'1240gitlab # [ 227.645867] sidekiq-cluster[2038]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1241gitlab # [ 227.649755] sidekiq-cluster[2038]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1242gitlab # [ 229.294274] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:13:43.934Z","message":"Booted Rails 7.2.3.1 application in production environment"}1243gitlab # [ 229.296965] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:13:43.937Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1244gitlab # [ 229.299650] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:13:43.940Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1245gitlab # [ 229.305490] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:13:43.940Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1246gitlab # [ 229.311707] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:13:43.943Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1247gitlab # [ 230.014925] gitlab-workhorse[822]: time="2026-09-18T22:13:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1248gitlab # [ 232.566374] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:13:47.205Z","message":"Cleaning working queues"}1249gitlab # [ 232.571433] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:13:47.210Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"a3fff751627bfa3736f77115","created_at":"2026-09-18T22:11:58.936Z","trace_propagation_headers":{"sentry-trace":"7ef268decc1a4079b91864c833140cf7-b719b2627cf14fbd","baggage":"sentry-trace_id=7ef268decc1a4079b91864c833140cf7,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"75e2ca11d48d59f20e8957dbe8e04563","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-18T22:11:58.949Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-a3fff751627bfa3736f77115: start","job_status":"start","queue_duration_s":108.261483,"scheduling_latency_s":108.261622}1250gitlab # [ 232.998733] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:13:47.638Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"a3fff751627bfa3736f77115","created_at":"2026-09-18T22:11:58.936Z","trace_propagation_headers":{"sentry-trace":"7ef268decc1a4079b91864c833140cf7-b719b2627cf14fbd","baggage":"sentry-trace_id=7ef268decc1a4079b91864c833140cf7,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"75e2ca11d48d59f20e8957dbe8e04563","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-18T22:11:58.949Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-a3fff751627bfa3736f77115: done: 0.427944 sec","job_status":"done","queue_duration_s":108.261483,"scheduling_latency_s":108.261622,"redis_calls":29,"redis_duration_s":0.016389,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.00971,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003923,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002756,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.211185,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.19715090000000002,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.427944,"completed_at":"2026-09-18T22:13:47.637Z","load_balancing_strategy":"primary","db_duration_s":0.113431,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1251gitlab # [ 233.847755] bundle[1986]: {"timestamp":"2026-09-18T22:13:48.486Z","pid":1986,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1252gitlab # [ 233.848284] bundle[1986]: {"timestamp":"2026-09-18T22:13:48.487Z","pid":1986,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1253gitlab # [ 233.848504] bundle[1986]: {"timestamp":"2026-09-18T22:13:48.487Z","pid":1986,"message":"! #\u003cThread:0x0000f13e69bb86b0 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1254gitlab # [ 233.848646] bundle[1986]: {"timestamp":"2026-09-18T22:13:48.487Z","pid":1986,"message":"! #\u003cThread:0x0000f13e68bf4f80 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1255gitlab # [ 233.848755] bundle[1986]: {"timestamp":"2026-09-18T22:13:48.487Z","pid":1986,"message":"Use Ctrl-C to stop"}1256gitlab # [ 233.848872] bundle[1986]: {"timestamp":"2026-09-18T22:13:48.488Z","pid":1986,"message":"Sending status to systemd every 1.0 sec"}1257gitlab # [ 234.657471] bundle[1986]: {"timestamp":"2026-09-18T22:13:49.297Z","pid":1986,"message":"- Worker 0 (PID: 2966) booted in 0.74s, phase: 0"}1258gitlab # [ 234.719460] bundle[1986]: {"timestamp":"2026-09-18T22:13:49.359Z","pid":1986,"message":"- Worker 1 (PID: 2970) booted in 0.74s, phase: 0"}1259gitlab # [ 234.727197] systemd[1]: Started gitlab.service.1260gitlab # [ 234.729094] systemd[1]: Reached target Common target for all GitLab services..1261gitlab # [ 234.735171] systemd[1]: Starting setup-gitlab.service...1262gitlab # [ 234.777673] setup-gitlab-start[3003]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1263gitlab # [ 238.655175] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:13:53 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 38161264gitlab # [ 238.660298] setup-gitlab-start[3003]: + TOKEN=nixbot-test-token-of-20-chars1265gitlab # [ 238.661129] setup-gitlab-start[3003]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1266gitlab # [ 238.680702] runuser[3029]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1267gitlab # [ 239.274282] setup-gitlab-start[3030]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1268gitlab # [ 239.280867] setup-gitlab-start[3030]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1269gitlab # [ 239.287065] setup-gitlab-start[3030]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1270gitlab # [ 240.152528] setup-gitlab-start[3030]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1271gitlab # [ 240.152931] setup-gitlab-start[3030]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1272gitlab # [ 240.155636] setup-gitlab-start[3030]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1273gitlab # [ 244.615882] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:13:59.254Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"9a1f64c8faa895e85337f25e","created_at":"2026-09-18T22:13:59.158Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c78e8bbc31598c8ef3b060aa7bad197e","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-18T22:13:59.250Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-9a1f64c8faa895e85337f25e: start","job_status":"start","queue_duration_s":0.00427,"scheduling_latency_s":0.004336}1274gitlab # [ 246.075944] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:00.714Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"9a1f64c8faa895e85337f25e","created_at":"2026-09-18T22:13:59.158Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c78e8bbc31598c8ef3b060aa7bad197e","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-18T22:13:59.250Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-9a1f64c8faa895e85337f25e: done: 1.460568 sec","job_status":"done","queue_duration_s":0.00427,"scheduling_latency_s":0.004336,"redis_calls":565,"redis_duration_s":0.806412,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.005652,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004392,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.796368,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.652562,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039758,"duration_s":1.460568,"completed_at":"2026-09-18T22:14:00.714Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018214,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1275gitlab # [ 246.076757] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:00.716Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"3d87b5dbc01fe6450b8b1b3c","created_at":"2026-09-18T22:13:59.270Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"123079ed5306d716446352df7f2b0a75","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-18T22:13:59.284Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-3d87b5dbc01fe6450b8b1b3c: start","job_status":"start","queue_duration_s":1.432496,"scheduling_latency_s":1.43252}1276gitlab # [ 246.215961] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:00.855Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"3d87b5dbc01fe6450b8b1b3c","created_at":"2026-09-18T22:13:59.270Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"123079ed5306d716446352df7f2b0a75","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-18T22:13:59.284Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-3d87b5dbc01fe6450b8b1b3c: done: 0.138505 sec","job_status":"done","queue_duration_s":1.432496,"scheduling_latency_s":1.43252,"redis_calls":19,"redis_duration_s":0.006356,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001733,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000607,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002963,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001053,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.075,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.075,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051641,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00049998,"duration_s":0.138505,"completed_at":"2026-09-18T22:14:00.855Z","load_balancing_strategy":"primary","db_duration_s":0.074458,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1277gitlab # [ 246.316362] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:00.858Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"194f0663ea6f9d78f6adc438","created_at":"2026-09-18T22:13:59.289Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f94c634bd5408b17d8d5405fa3f8fde","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-18T22:13:59.310Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-194f0663ea6f9d78f6adc438: start","job_status":"start","queue_duration_s":1.548111,"scheduling_latency_s":1.548145}1278gitlab # [ 246.332070] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:00.938Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1279gitlab # [ 246.335956] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:00.960Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"194f0663ea6f9d78f6adc438","created_at":"2026-09-18T22:13:59.289Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f94c634bd5408b17d8d5405fa3f8fde","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-18T22:13:59.310Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-194f0663ea6f9d78f6adc438: done: 0.101362 sec","job_status":"done","queue_duration_s":1.548111,"scheduling_latency_s":1.548145,"redis_calls":10,"redis_duration_s":0.0041270000000000005,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000848,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002395,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000884,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.057,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.057,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027909,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00107158,"duration_s":0.101362,"completed_at":"2026-09-18T22:14:00.960Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.056514,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1280gitlab # [ 246.379619] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:00.964Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"57b962244b5c146a14a36dd8","created_at":"2026-09-18T22:13:59.349Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f80b677b5f315891e5cdf6902ee2809d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-09-18T22:13:59.360Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-57b962244b5c146a14a36dd8: start","job_status":"start","queue_duration_s":1.604038,"scheduling_latency_s":1.604083}1281gitlab # [ 246.402407] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:01.041Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"57b962244b5c146a14a36dd8","created_at":"2026-09-18T22:13:59.349Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f80b677b5f315891e5cdf6902ee2809d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-09-18T22:13:59.360Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-57b962244b5c146a14a36dd8: done: 0.077408 sec","job_status":"done","queue_duration_s":1.604038,"scheduling_latency_s":1.604083,"redis_calls":12,"redis_duration_s":0.005333,"redis_read_bytes":11,"redis_write_bytes":1281,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000974,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002345,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":518,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002014,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":476,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047471,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00139578,"exclusive_lock_hold_duration_s":0.024976560000000002,"duration_s":0.077408,"completed_at":"2026-09-18T22:14:01.041Z","load_balancing_strategy":"primary","db_duration_s":0.011269,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1282gitlab # [ 246.447889] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:01.045Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"f1a64f466f463e1953cc9ad7","created_at":"2026-09-18T22:13:59.367Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"18a8bc4eaec12e29e2c138d7363f2f37","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-18T22:13:59.376Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-f1a64f466f463e1953cc9ad7: start","job_status":"start","queue_duration_s":1.668094,"scheduling_latency_s":1.668131}1283gitlab # [ 246.552450] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:01.191Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"f1a64f466f463e1953cc9ad7","created_at":"2026-09-18T22:13:59.367Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"18a8bc4eaec12e29e2c138d7363f2f37","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-18T22:13:59.376Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-f1a64f466f463e1953cc9ad7: done: 0.146885 sec","job_status":"done","queue_duration_s":1.668094,"scheduling_latency_s":1.668131,"redis_calls":12,"redis_duration_s":0.005157,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000805,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002341,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002011,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.037,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.090025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00173662,"exclusive_lock_hold_duration_s":0.07494528,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.146885,"completed_at":"2026-09-18T22:14:01.191Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.041675,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1284gitlab # [ 246.644039] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:01.195Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"58b10b9dc47c1711e0844910","created_at":"2026-09-18T22:13:59.442Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"778c7e246544f3b45067a6b53c257ed9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-18T22:13:59.470Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-58b10b9dc47c1711e0844910: start","job_status":"start","queue_duration_s":1.72447,"scheduling_latency_s":1.724504}1285gitlab # [ 246.660762] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:01.237Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"58b10b9dc47c1711e0844910","created_at":"2026-09-18T22:13:59.442Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"778c7e246544f3b45067a6b53c257ed9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-18T22:13:59.470Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-58b10b9dc47c1711e0844910: done: 0.042103 sec","job_status":"done","queue_duration_s":1.72447,"scheduling_latency_s":1.724504,"redis_calls":12,"redis_duration_s":0.004541,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002084,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00178,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000677,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026709,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00042856,"duration_s":0.042103,"completed_at":"2026-09-18T22:14:01.237Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001794,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1286gitlab # [ 246.703389] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:01.239Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"aa47ff7b25e8e8c33ff16874","created_at":"2026-09-18T22:13:59.543Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f4ff5bdc399c65c7eb8bf9a7dc248d0","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-18T22:13:59.562Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-aa47ff7b25e8e8c33ff16874: start","job_status":"start","queue_duration_s":1.676798,"scheduling_latency_s":1.676823}1287gitlab # [ 246.717958] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:01.272Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"aa47ff7b25e8e8c33ff16874","created_at":"2026-09-18T22:13:59.543Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f4ff5bdc399c65c7eb8bf9a7dc248d0","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-18T22:13:59.562Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-aa47ff7b25e8e8c33ff16874: done: 0.033341 sec","job_status":"done","queue_duration_s":1.676798,"scheduling_latency_s":1.676823,"redis_calls":12,"redis_duration_s":0.003613,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000612,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00159,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001411,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018803,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00076084,"exclusive_lock_hold_duration_s":0.00528802,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.033341,"completed_at":"2026-09-18T22:14:01.272Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003176,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1288gitlab # [ 246.760418] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:01.274Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"4601597ff9d53f383adeb6f4","created_at":"2026-09-18T22:13:59.599Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-18T22:13:59.619Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-4601597ff9d53f383adeb6f4: start","job_status":"start","queue_duration_s":1.65579,"scheduling_latency_s":1.655812}1289gitlab # [ 246.775034] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:01.403Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"4601597ff9d53f383adeb6f4","created_at":"2026-09-18T22:13:59.599Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-18T22:13:59.619Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-4601597ff9d53f383adeb6f4: done: 0.128456 sec","job_status":"done","queue_duration_s":1.65579,"scheduling_latency_s":1.655812,"redis_calls":71,"redis_duration_s":0.020012000000000002,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.003083,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001368,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.014663,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000898,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.105358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037678,"duration_s":0.128456,"completed_at":"2026-09-18T22:14:01.403Z","load_balancing_strategy":"primary","db_duration_s":0.003155,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1290gitlab # [ 246.817502] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:01.405Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"e8ff580924cb9818bf2c9ff5","created_at":"2026-09-18T22:13:59.650Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"39279c0a46e19d262f156dfaa91e7a46","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-18T22:13:59.671Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-e8ff580924cb9818bf2c9ff5: start","job_status":"start","queue_duration_s":1.733493,"scheduling_latency_s":1.733515}1291gitlab # [ 246.830845] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:01.420Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1292gitlab # [ 246.834781] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:01.428Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"e8ff580924cb9818bf2c9ff5","created_at":"2026-09-18T22:13:59.650Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"39279c0a46e19d262f156dfaa91e7a46","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-18T22:13:59.671Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-e8ff580924cb9818bf2c9ff5: done: 0.023441 sec","job_status":"done","queue_duration_s":1.733493,"scheduling_latency_s":1.733515,"redis_calls":10,"redis_duration_s":0.002857,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000665,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001533,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000659,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003807,"duration_s":0.023441,"completed_at":"2026-09-18T22:14:01.428Z","load_balancing_strategy":"primary","db_duration_s":0.000833,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1293gitlab # [ 246.876579] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:01.430Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"fcc035fdba238c185968730e","created_at":"2026-09-18T22:13:59.705Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b4848c037c707e895584010c648e33b6","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-18T22:13:59.731Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-fcc035fdba238c185968730e: start","job_status":"start","queue_duration_s":1.69948,"scheduling_latency_s":1.699498}1294gitlab # [ 246.891273] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:01.495Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"fcc035fdba238c185968730e","created_at":"2026-09-18T22:13:59.705Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b4848c037c707e895584010c648e33b6","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-18T22:13:59.731Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-fcc035fdba238c185968730e: done: 0.064617 sec","job_status":"done","queue_duration_s":1.69948,"scheduling_latency_s":1.699498,"redis_calls":16,"redis_duration_s":0.0061790000000000005,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003889,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001826,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000464,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00062644,"duration_s":0.064617,"completed_at":"2026-09-18T22:14:01.495Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012505,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1295gitlab # [ 246.933446] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:01.498Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"bb1da2e8c3545b0693a1a4ff","created_at":"2026-09-18T22:13:59.796Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"23b04176a7a9c53e5d870b8bea7f0bd2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-18T22:13:59.816Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-bb1da2e8c3545b0693a1a4ff: start","job_status":"start","queue_duration_s":1.682013,"scheduling_latency_s":1.682042}1296gitlab # [ 246.948086] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:01.525Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1297gitlab # [ 246.951528] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:01.543Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"bb1da2e8c3545b0693a1a4ff","created_at":"2026-09-18T22:13:59.796Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"23b04176a7a9c53e5d870b8bea7f0bd2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-18T22:13:59.816Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-bb1da2e8c3545b0693a1a4ff: done: 0.045231 sec","job_status":"done","queue_duration_s":1.682013,"scheduling_latency_s":1.682042,"redis_calls":10,"redis_duration_s":0.0031320000000000002,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00071,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001742,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00068,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025198,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031488,"duration_s":0.045231,"completed_at":"2026-09-18T22:14:01.543Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001009,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1298gitlab # [ 246.995315] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:01.546Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"5905e5e6dd852c1ecf18deec","created_at":"2026-09-18T22:13:59.853Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3306871b855b0732725d1aa94eb70b78","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-18T22:13:59.875Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-5905e5e6dd852c1ecf18deec: start","job_status":"start","queue_duration_s":1.670222,"scheduling_latency_s":1.67025}1299gitlab # [ 247.375795] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:02.013Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"5905e5e6dd852c1ecf18deec","created_at":"2026-09-18T22:13:59.853Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3306871b855b0732725d1aa94eb70b78","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-18T22:13:59.875Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-5905e5e6dd852c1ecf18deec: done: 0.467536 sec","job_status":"done","queue_duration_s":1.670222,"scheduling_latency_s":1.67025,"redis_calls":14,"redis_duration_s":0.004647,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001255,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001924,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001468,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.08,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.08,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.367577,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00074008,"exclusive_lock_hold_duration_s":0.42121655999999996,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.467536,"completed_at":"2026-09-18T22:14:02.013Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.114165,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 247.473083] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:02.016Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"532a6c4b2ed5dd933846e9dd","created_at":"2026-09-18T22:13:59.897Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"deae2a65184b3d2c39510c73ce6d1cc3","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-18T22:13:59.923Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-532a6c4b2ed5dd933846e9dd: start","job_status":"start","queue_duration_s":2.093409,"scheduling_latency_s":2.093433}1301gitlab # [ 247.500581] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:02.139Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"532a6c4b2ed5dd933846e9dd","created_at":"2026-09-18T22:13:59.897Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"deae2a65184b3d2c39510c73ce6d1cc3","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-18T22:13:59.923Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-532a6c4b2ed5dd933846e9dd: done: 0.123038 sec","job_status":"done","queue_duration_s":2.093409,"scheduling_latency_s":2.093433,"redis_calls":10,"redis_duration_s":0.00494,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000945,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003012,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000983,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.052,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.052,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041337,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00108312,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.123038,"completed_at":"2026-09-18T22:14:02.139Z","load_balancing_strategy":"primary","db_duration_s":0.058371,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 247.564112] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:02.144Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"2292d5fae4537db42e33bcab","created_at":"2026-09-18T22:13:59.948Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0add56bde4e736cfc227e85056cadc8","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-18T22:13:59.979Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-2292d5fae4537db42e33bcab: start","job_status":"start","queue_duration_s":2.165441,"scheduling_latency_s":2.165535}1303gitlab # [ 247.606601] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:02.246Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"2292d5fae4537db42e33bcab","created_at":"2026-09-18T22:13:59.948Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0add56bde4e736cfc227e85056cadc8","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-18T22:13:59.979Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-2292d5fae4537db42e33bcab: done: 0.101734 sec","job_status":"done","queue_duration_s":2.165441,"scheduling_latency_s":2.165535,"redis_calls":13,"redis_duration_s":0.007868,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001078,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.004514,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002276,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.067962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.031457280000000004,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.101734,"completed_at":"2026-09-18T22:14:02.246Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009655,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1304gitlab # [ 247.667292] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:02.249Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"92cd7064144cf730ac2efde1","created_at":"2026-09-18T22:14:00.029Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"18428b237d1f0512848f43378aeeafba","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-18T22:14:00.051Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-92cd7064144cf730ac2efde1: start","job_status":"start","queue_duration_s":2.198642,"scheduling_latency_s":2.198697}1305gitlab # [ 247.681736] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:02.276Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1306gitlab # [ 247.685190] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:02.293Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"92cd7064144cf730ac2efde1","created_at":"2026-09-18T22:14:00.029Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"18428b237d1f0512848f43378aeeafba","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-18T22:14:00.051Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-92cd7064144cf730ac2efde1: done: 0.043648 sec","job_status":"done","queue_duration_s":2.198642,"scheduling_latency_s":2.198697,"redis_calls":10,"redis_duration_s":0.003969,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000879,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002435,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000655,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025535,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0009767,"duration_s":0.043648,"completed_at":"2026-09-18T22:14:02.293Z","load_balancing_strategy":"primary","db_duration_s":0.001322,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1307gitlab # [ 247.726141] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:02.296Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"3c2ec0e37e6c1a5b1cbc7f22","created_at":"2026-09-18T22:14:00.097Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fb0ba571cbc9cb9ce9b21c112a2f1050","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-18T22:14:00.117Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-3c2ec0e37e6c1a5b1cbc7f22: start","job_status":"start","queue_duration_s":2.178377,"scheduling_latency_s":2.178421}1308gitlab # [ 247.739306] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:02.375Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"3c2ec0e37e6c1a5b1cbc7f22","created_at":"2026-09-18T22:14:00.097Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fb0ba571cbc9cb9ce9b21c112a2f1050","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-18T22:14:00.117Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-3c2ec0e37e6c1a5b1cbc7f22: done: 0.079131 sec","job_status":"done","queue_duration_s":2.178377,"scheduling_latency_s":2.178421,"redis_calls":10,"redis_duration_s":0.004263,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000894,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002533,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000836,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048369,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005262,"duration_s":0.079131,"completed_at":"2026-09-18T22:14:02.375Z","load_balancing_strategy":"primary","db_duration_s":0.014089,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1309gitlab # [ 247.779685] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:02.378Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"207335dab8910dc4827cc231","created_at":"2026-09-18T22:14:00.152Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e5e078c58886d5d9e67038da785110e2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:00.177Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-207335dab8910dc4827cc231: start","job_status":"start","queue_duration_s":2.200946,"scheduling_latency_s":2.200969}1310gitlab # [ 247.799782] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:02.439Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"207335dab8910dc4827cc231","created_at":"2026-09-18T22:14:00.152Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e5e078c58886d5d9e67038da785110e2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:00.177Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-207335dab8910dc4827cc231: done: 0.061248 sec","job_status":"done","queue_duration_s":2.200946,"scheduling_latency_s":2.200969,"redis_calls":12,"redis_duration_s":0.005201,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000768,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002349,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002084,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00098366,"exclusive_lock_hold_duration_s":0.01807054,"duration_s":0.061248,"completed_at":"2026-09-18T22:14:02.439Z","load_balancing_strategy":"primary","db_duration_s":0.010019,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1311gitlab # [ 247.841372] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:02.442Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"f39e41e2fffcfb67dfef61e1","created_at":"2026-09-18T22:14:00.197Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"65019558cefce9ffc4b66cca3a6450c4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:00.221Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-f39e41e2fffcfb67dfef61e1: start","job_status":"start","queue_duration_s":2.221271,"scheduling_latency_s":2.221295}1312gitlab # [ 247.974586] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:02.614Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1313gitlab # [ 247.990565] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:02.630Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"f39e41e2fffcfb67dfef61e1","created_at":"2026-09-18T22:14:00.197Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"65019558cefce9ffc4b66cca3a6450c4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:00.221Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-f39e41e2fffcfb67dfef61e1: done: 0.187561 sec","job_status":"done","queue_duration_s":2.221271,"scheduling_latency_s":2.221295,"redis_calls":10,"redis_duration_s":0.004319,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000956,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00236,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001003,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025999,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006343,"duration_s":0.187561,"completed_at":"2026-09-18T22:14:02.630Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001561,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 248.075027] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:02.633Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"7246e8b390286641d06b42e9","created_at":"2026-09-18T22:14:00.274Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"02e0e0a56d10eb8920f2e01398dd80ff","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:00.296Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-7246e8b390286641d06b42e9: start","job_status":"start","queue_duration_s":2.337276,"scheduling_latency_s":2.337325}1315gitlab # [ 248.094923] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:02.723Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"7246e8b390286641d06b42e9","created_at":"2026-09-18T22:14:00.274Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"02e0e0a56d10eb8920f2e01398dd80ff","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:00.296Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-7246e8b390286641d06b42e9: done: 0.089679 sec","job_status":"done","queue_duration_s":2.337276,"scheduling_latency_s":2.337325,"redis_calls":10,"redis_duration_s":0.004937,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000937,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00318,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00082,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00163998,"duration_s":0.089679,"completed_at":"2026-09-18T22:14:02.722Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01024,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 248.142766] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:02.729Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"a5d65fab0fea0c6ac54da5f2","created_at":"2026-09-18T22:14:00.321Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"50dc66f853da5d08ec08f2d4fd54d47d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:00.346Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-a5d65fab0fea0c6ac54da5f2: start","job_status":"start","queue_duration_s":2.383241,"scheduling_latency_s":2.383352}1317gitlab # [ 248.246988] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:02.886Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"a5d65fab0fea0c6ac54da5f2","created_at":"2026-09-18T22:14:00.321Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"50dc66f853da5d08ec08f2d4fd54d47d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:00.346Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-a5d65fab0fea0c6ac54da5f2: done: 0.156607 sec","job_status":"done","queue_duration_s":2.383241,"scheduling_latency_s":2.383352,"redis_calls":14,"redis_duration_s":0.008433,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002318,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003546,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002569,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.109075,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00156578,"exclusive_lock_hold_duration_s":0.06153604,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.156607,"completed_at":"2026-09-18T22:14:02.885Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021173,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 248.326255] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:02.890Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"d90ae9c1bd8b3694f3b972d0","created_at":"2026-09-18T22:14:00.365Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f63cd83cc24e0249a5a1751ebb93cdf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:00.389Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-d90ae9c1bd8b3694f3b972d0: start","job_status":"start","queue_duration_s":2.500902,"scheduling_latency_s":2.500967}1319gitlab # [ 248.342463] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:02.935Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1320gitlab # [ 248.358382] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:02.996Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"d90ae9c1bd8b3694f3b972d0","created_at":"2026-09-18T22:14:00.365Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f63cd83cc24e0249a5a1751ebb93cdf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:00.389Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-d90ae9c1bd8b3694f3b972d0: done: 0.106607 sec","job_status":"done","queue_duration_s":2.500902,"scheduling_latency_s":2.500967,"redis_calls":10,"redis_duration_s":0.006505,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001177,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004094,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001234,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065715,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00197404,"duration_s":0.106607,"completed_at":"2026-09-18T22:14:02.996Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001199,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321gitlab # [ 248.418592] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.003Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"2d17c7c2195d3882b86007d2","created_at":"2026-09-18T22:14:00.424Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5e06630d8d18167d48c5830c817c869f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:00.452Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-2d17c7c2195d3882b86007d2: start","job_status":"start","queue_duration_s":2.550695,"scheduling_latency_s":2.5508}1322gitlab # [ 248.443164] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.082Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"2d17c7c2195d3882b86007d2","created_at":"2026-09-18T22:14:00.424Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5e06630d8d18167d48c5830c817c869f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:00.452Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-2d17c7c2195d3882b86007d2: done: 0.07935 sec","job_status":"done","queue_duration_s":2.550695,"scheduling_latency_s":2.5508,"redis_calls":10,"redis_duration_s":0.005656,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001157,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003369,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00113,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00101682,"duration_s":0.07935,"completed_at":"2026-09-18T22:14:03.082Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001403,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323gitlab # [ 248.494428] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.086Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ad28227d8557ce45b2b0b73d","created_at":"2026-09-18T22:14:00.813Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-5bdcb4d937354c1f","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"123079ed5306d716446352df7f2b0a75","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:00.840Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ad28227d8557ce45b2b0b73d: start","job_status":"start","queue_duration_s":2.245832,"scheduling_latency_s":2.245893}1324gitlab # [ 248.506973] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.132Z","message":"No existing merge request to be cleaned up."}1325gitlab # [ 248.531449] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.171Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ad28227d8557ce45b2b0b73d","created_at":"2026-09-18T22:14:00.813Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-5bdcb4d937354c1f","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"123079ed5306d716446352df7f2b0a75","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:00.840Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ad28227d8557ce45b2b0b73d: done: 0.084469 sec","job_status":"done","queue_duration_s":2.245832,"scheduling_latency_s":2.245893,"redis_calls":13,"redis_duration_s":0.006867,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000991,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002379,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003497,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049638,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0008133,"duration_s":0.084469,"completed_at":"2026-09-18T22:14:03.171Z","load_balancing_strategy":"primary","db_duration_s":0.013231,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 248.572536] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.174Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"af3986736bab9f5db36216b3","created_at":"2026-09-18T22:14:00.813Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-5bdcb4d937354c1f","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"123079ed5306d716446352df7f2b0a75","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:00.840Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-af3986736bab9f5db36216b3: start","job_status":"start","queue_duration_s":2.333538,"scheduling_latency_s":2.333568}1327gitlab # [ 248.584982] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.201Z","message":"No existing merge request to be cleaned up."}1328gitlab # [ 248.586628] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.221Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"af3986736bab9f5db36216b3","created_at":"2026-09-18T22:14:00.813Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-5bdcb4d937354c1f","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"123079ed5306d716446352df7f2b0a75","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:00.840Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-af3986736bab9f5db36216b3: done: 0.046701 sec","job_status":"done","queue_duration_s":2.333538,"scheduling_latency_s":2.333568,"redis_calls":10,"redis_duration_s":0.00429,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001742,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002548,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031914,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.046701,"completed_at":"2026-09-18T22:14:03.221Z","load_balancing_strategy":"primary","db_duration_s":0.004744,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1329gitlab # [ 248.624373] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.224Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0036794ebe9ae63f1700287e","created_at":"2026-09-18T22:14:00.813Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-5bdcb4d937354c1f","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"123079ed5306d716446352df7f2b0a75","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:00.840Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0036794ebe9ae63f1700287e: start","job_status":"start","queue_duration_s":2.383229,"scheduling_latency_s":2.383271}1330gitlab # [ 248.637682] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.250Z","message":"No existing merge request to be cleaned up."}1331gitlab # [ 248.639321] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.270Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0036794ebe9ae63f1700287e","created_at":"2026-09-18T22:14:00.813Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-5bdcb4d937354c1f","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"123079ed5306d716446352df7f2b0a75","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:00.840Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0036794ebe9ae63f1700287e: done: 0.046694 sec","job_status":"done","queue_duration_s":2.383229,"scheduling_latency_s":2.383271,"redis_calls":10,"redis_duration_s":0.00451,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001919,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002591,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02913,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.046694,"completed_at":"2026-09-18T22:14:03.270Z","load_balancing_strategy":"primary","db_duration_s":0.004902,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 248.677753] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.274Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"79a4ea0ee8bec7d60dee6fc7","created_at":"2026-09-18T22:14:00.813Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-5bdcb4d937354c1f","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"123079ed5306d716446352df7f2b0a75","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:00.840Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-79a4ea0ee8bec7d60dee6fc7: start","job_status":"start","queue_duration_s":2.433048,"scheduling_latency_s":2.433074}1333gitlab # [ 248.690024] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.300Z","message":"No existing merge request to be cleaned up."}1334gitlab # [ 248.691642] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.317Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"79a4ea0ee8bec7d60dee6fc7","created_at":"2026-09-18T22:14:00.813Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-5bdcb4d937354c1f","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"123079ed5306d716446352df7f2b0a75","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:00.840Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-79a4ea0ee8bec7d60dee6fc7: done: 0.043112 sec","job_status":"done","queue_duration_s":2.433048,"scheduling_latency_s":2.433074,"redis_calls":10,"redis_duration_s":0.004323,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001831,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002492,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029552,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043112,"completed_at":"2026-09-18T22:14:03.317Z","load_balancing_strategy":"primary","db_duration_s":0.004245,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335gitlab # [ 248.729647] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.320Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d14e22f8e3d8294f69cd334","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d14e22f8e3d8294f69cd334: start","job_status":"start","queue_duration_s":1.928274,"scheduling_latency_s":1.928304}1336gitlab # [ 248.742036] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.373Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d14e22f8e3d8294f69cd334","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d14e22f8e3d8294f69cd334: done: 0.053377 sec","job_status":"done","queue_duration_s":1.928274,"scheduling_latency_s":1.928304,"redis_calls":16,"redis_duration_s":0.0066890000000000005,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000729,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002017,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003943,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032988,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006974,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.053377,"completed_at":"2026-09-18T22:14:03.373Z","load_balancing_strategy":"primary","db_duration_s":0.001272,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337gitlab # [ 248.783029] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c452340802f3593c2a8961d","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c452340802f3593c2a8961d: start","job_status":"start","queue_duration_s":1.984505,"scheduling_latency_s":1.98453}1338gitlab # [ 248.795467] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.411Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c452340802f3593c2a8961d","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c452340802f3593c2a8961d: done: 0.035726 sec","job_status":"done","queue_duration_s":1.984505,"scheduling_latency_s":1.98453,"redis_calls":13,"redis_duration_s":0.0046359999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001457,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003179,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035726,"completed_at":"2026-09-18T22:14:03.411Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339gitlab # [ 248.834528] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.415Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7c555decc9702c2e462e86f","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7c555decc9702c2e462e86f: start","job_status":"start","queue_duration_s":2.024092,"scheduling_latency_s":2.024155}1340gitlab # [ 248.848331] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.453Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7c555decc9702c2e462e86f","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7c555decc9702c2e462e86f: done: 0.037448 sec","job_status":"done","queue_duration_s":2.024092,"scheduling_latency_s":2.024155,"redis_calls":13,"redis_duration_s":0.005084,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001696,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003388,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026686,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.037448,"completed_at":"2026-09-18T22:14:03.453Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 248.887465] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.456Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"140382fcaafca9a48973b268","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-140382fcaafca9a48973b268: start","job_status":"start","queue_duration_s":2.064705,"scheduling_latency_s":2.064727}1342gitlab # [ 248.899918] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.519Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"140382fcaafca9a48973b268","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-140382fcaafca9a48973b268: done: 0.062688 sec","job_status":"done","queue_duration_s":2.064705,"scheduling_latency_s":2.064727,"redis_calls":13,"redis_duration_s":0.005636,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002132,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003504,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045367,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.062688,"completed_at":"2026-09-18T22:14:03.519Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 248.938753] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.525Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5124bb8fa356fae497043cf","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5124bb8fa356fae497043cf: start","job_status":"start","queue_duration_s":2.133765,"scheduling_latency_s":2.133821}1344gitlab # [ 248.956807] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.595Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5124bb8fa356fae497043cf","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5124bb8fa356fae497043cf: done: 0.070397 sec","job_status":"done","queue_duration_s":2.133765,"scheduling_latency_s":2.133821,"redis_calls":13,"redis_duration_s":0.006757,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002685,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004072,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048349,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.070397,"completed_at":"2026-09-18T22:14:03.595Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345gitlab # [ 248.998155] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.600Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"103d98e950eb02ef91cf7ecd","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-103d98e950eb02ef91cf7ecd: start","job_status":"start","queue_duration_s":2.208884,"scheduling_latency_s":2.208946}1346gitlab # [ 249.022608] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.661Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"103d98e950eb02ef91cf7ecd","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-103d98e950eb02ef91cf7ecd: done: 0.061462 sec","job_status":"done","queue_duration_s":2.208884,"scheduling_latency_s":2.208946,"redis_calls":13,"redis_duration_s":0.008975,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005422,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003553,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038697,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.061462,"completed_at":"2026-09-18T22:14:03.661Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 249.065151] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.665Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad6c1bb510042f7652dd154e","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad6c1bb510042f7652dd154e: start","job_status":"start","queue_duration_s":2.273917,"scheduling_latency_s":2.273947}1348gitlab # [ 249.077882] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.704Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad6c1bb510042f7652dd154e","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad6c1bb510042f7652dd154e: done: 0.039303 sec","job_status":"done","queue_duration_s":2.273917,"scheduling_latency_s":2.273947,"redis_calls":13,"redis_duration_s":0.004043,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000977,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003066,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02732,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.039303,"completed_at":"2026-09-18T22:14:03.704Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 249.117239] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.707Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f13b88428fa02a30d1e9e09","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f13b88428fa02a30d1e9e09: start","job_status":"start","queue_duration_s":2.315881,"scheduling_latency_s":2.315907}1350gitlab # [ 249.129733] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.746Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f13b88428fa02a30d1e9e09","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f13b88428fa02a30d1e9e09: done: 0.038563 sec","job_status":"done","queue_duration_s":2.315881,"scheduling_latency_s":2.315907,"redis_calls":13,"redis_duration_s":0.003532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001193,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002339,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028746,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038563,"completed_at":"2026-09-18T22:14:03.746Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 249.168804] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.748Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dfd577b1754de985e1655d7f","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dfd577b1754de985e1655d7f: start","job_status":"start","queue_duration_s":2.357017,"scheduling_latency_s":2.357095}1352gitlab # [ 249.181335] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.785Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dfd577b1754de985e1655d7f","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dfd577b1754de985e1655d7f: done: 0.036627 sec","job_status":"done","queue_duration_s":2.357017,"scheduling_latency_s":2.357095,"redis_calls":13,"redis_duration_s":0.003171,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001064,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002107,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036627,"completed_at":"2026-09-18T22:14:03.785Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 249.221193] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.788Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae69c9075b58320a2a6f63f3","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae69c9075b58320a2a6f63f3: start","job_status":"start","queue_duration_s":2.396427,"scheduling_latency_s":2.396455}1354gitlab # [ 249.233802] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.823Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae69c9075b58320a2a6f63f3","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae69c9075b58320a2a6f63f3: done: 0.035079 sec","job_status":"done","queue_duration_s":2.396427,"scheduling_latency_s":2.396455,"redis_calls":13,"redis_duration_s":0.003096,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00111,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024569,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035079,"completed_at":"2026-09-18T22:14:03.823Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 249.274498] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b550802a5ebbf54d8b14ec1","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b550802a5ebbf54d8b14ec1: start","job_status":"start","queue_duration_s":2.435382,"scheduling_latency_s":2.43541}1356gitlab # [ 249.287490] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.861Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b550802a5ebbf54d8b14ec1","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b550802a5ebbf54d8b14ec1: done: 0.034793 sec","job_status":"done","queue_duration_s":2.435382,"scheduling_latency_s":2.43541,"redis_calls":13,"redis_duration_s":0.0031739999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001063,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002111,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02529,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034793,"completed_at":"2026-09-18T22:14:03.861Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 249.326443] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.864Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b58f5d3b5f22be71d84e5424","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b58f5d3b5f22be71d84e5424: start","job_status":"start","queue_duration_s":2.472569,"scheduling_latency_s":2.472624}1358gitlab # [ 249.338764] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.899Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b58f5d3b5f22be71d84e5424","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b58f5d3b5f22be71d84e5424: done: 0.034798 sec","job_status":"done","queue_duration_s":2.472569,"scheduling_latency_s":2.472624,"redis_calls":13,"redis_duration_s":0.002823,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00098,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001843,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02544,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034798,"completed_at":"2026-09-18T22:14:03.898Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 249.376819] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.901Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd664882493e0b912bb2cddc","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd664882493e0b912bb2cddc: start","job_status":"start","queue_duration_s":2.510041,"scheduling_latency_s":2.510083}1360gitlab # [ 249.389052] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.939Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd664882493e0b912bb2cddc","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd664882493e0b912bb2cddc: done: 0.037704 sec","job_status":"done","queue_duration_s":2.510041,"scheduling_latency_s":2.510083,"redis_calls":13,"redis_duration_s":0.0032719999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001135,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002137,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027581,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.037704,"completed_at":"2026-09-18T22:14:03.939Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 249.428265] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.942Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3338da17dda13bc897c8bcdd","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3338da17dda13bc897c8bcdd: start","job_status":"start","queue_duration_s":2.550288,"scheduling_latency_s":2.550323}1362gitlab # [ 249.440126] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.979Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3338da17dda13bc897c8bcdd","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3338da17dda13bc897c8bcdd: done: 0.037833 sec","job_status":"done","queue_duration_s":2.550288,"scheduling_latency_s":2.550323,"redis_calls":13,"redis_duration_s":0.00315,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001164,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026742,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.037833,"completed_at":"2026-09-18T22:14:03.979Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 249.479986] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:03.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d0a7efd254bd66006f59933","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d0a7efd254bd66006f59933: start","job_status":"start","queue_duration_s":2.590574,"scheduling_latency_s":2.590595}1364gitlab # [ 249.492176] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.017Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d0a7efd254bd66006f59933","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d0a7efd254bd66006f59933: done: 0.035155 sec","job_status":"done","queue_duration_s":2.590574,"scheduling_latency_s":2.590595,"redis_calls":13,"redis_duration_s":0.0030729999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001104,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001969,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025545,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035155,"completed_at":"2026-09-18T22:14:04.017Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 249.530257] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.019Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5251e34e0c600892fb2ec5f","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5251e34e0c600892fb2ec5f: start","job_status":"start","queue_duration_s":2.628111,"scheduling_latency_s":2.628136}1366gitlab # [ 249.542417] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.054Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5251e34e0c600892fb2ec5f","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5251e34e0c600892fb2ec5f: done: 0.034466 sec","job_status":"done","queue_duration_s":2.628111,"scheduling_latency_s":2.628136,"redis_calls":13,"redis_duration_s":0.003059,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001036,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025551,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034466,"completed_at":"2026-09-18T22:14:04.054Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 249.582070] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.056Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7d51e88f9b977f89fc798c8","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7d51e88f9b977f89fc798c8: start","job_status":"start","queue_duration_s":2.664877,"scheduling_latency_s":2.664934}1368gitlab # [ 249.594742] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.088Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7d51e88f9b977f89fc798c8","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7d51e88f9b977f89fc798c8: done: 0.032129 sec","job_status":"done","queue_duration_s":2.664877,"scheduling_latency_s":2.664934,"redis_calls":13,"redis_duration_s":0.003332,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001024,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002308,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032129,"completed_at":"2026-09-18T22:14:04.088Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 249.633699] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.092Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d7e96e21e6ec93f0c21aafc","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d7e96e21e6ec93f0c21aafc: start","job_status":"start","queue_duration_s":2.700439,"scheduling_latency_s":2.700461}1370gitlab # [ 249.646252] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d7e96e21e6ec93f0c21aafc","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d7e96e21e6ec93f0c21aafc: done: 0.031669 sec","job_status":"done","queue_duration_s":2.700439,"scheduling_latency_s":2.700461,"redis_calls":13,"redis_duration_s":0.0030610000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001018,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002043,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031669,"completed_at":"2026-09-18T22:14:04.123Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 249.687277] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.125Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14f342fa5ee1c07334d9ed14","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14f342fa5ee1c07334d9ed14: start","job_status":"start","queue_duration_s":2.734167,"scheduling_latency_s":2.734186}1372gitlab # [ 249.699710] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.157Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14f342fa5ee1c07334d9ed14","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14f342fa5ee1c07334d9ed14: done: 0.031656 sec","job_status":"done","queue_duration_s":2.734167,"scheduling_latency_s":2.734186,"redis_calls":13,"redis_duration_s":0.002793,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000946,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001847,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023325,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031656,"completed_at":"2026-09-18T22:14:04.157Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 249.739729] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.159Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0100abcd7d6b81ab31adb77","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0100abcd7d6b81ab31adb77: start","job_status":"start","queue_duration_s":2.767922,"scheduling_latency_s":2.767943}1374gitlab # [ 249.752352] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.192Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0100abcd7d6b81ab31adb77","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0100abcd7d6b81ab31adb77: done: 0.032557 sec","job_status":"done","queue_duration_s":2.767922,"scheduling_latency_s":2.767943,"redis_calls":13,"redis_duration_s":0.003101,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001117,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001984,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023982,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032557,"completed_at":"2026-09-18T22:14:04.192Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 249.791217] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.194Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e33c910fc7256aed80fc95b3","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e33c910fc7256aed80fc95b3: start","job_status":"start","queue_duration_s":2.802589,"scheduling_latency_s":2.802608}1376gitlab # [ 249.803505] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e33c910fc7256aed80fc95b3","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e33c910fc7256aed80fc95b3: done: 0.030269 sec","job_status":"done","queue_duration_s":2.802589,"scheduling_latency_s":2.802608,"redis_calls":13,"redis_duration_s":0.002642,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000935,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001707,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021558,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030269,"completed_at":"2026-09-18T22:14:04.224Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 249.842514] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.227Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38c0935e09dfc93c48c57588","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38c0935e09dfc93c48c57588: start","job_status":"start","queue_duration_s":2.835914,"scheduling_latency_s":2.835947}1378gitlab # [ 249.855001] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.260Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38c0935e09dfc93c48c57588","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38c0935e09dfc93c48c57588: done: 0.032604 sec","job_status":"done","queue_duration_s":2.835914,"scheduling_latency_s":2.835947,"redis_calls":13,"redis_duration_s":0.003133,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000973,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00216,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032604,"completed_at":"2026-09-18T22:14:04.260Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 249.896359] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27eb157aabdac2b5f6279156","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27eb157aabdac2b5f6279156: start","job_status":"start","queue_duration_s":2.870544,"scheduling_latency_s":2.870578}1380gitlab # [ 249.933555] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.296Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27eb157aabdac2b5f6279156","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27eb157aabdac2b5f6279156: done: 0.034035 sec","job_status":"done","queue_duration_s":2.870544,"scheduling_latency_s":2.870578,"redis_calls":13,"redis_duration_s":0.003203,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001036,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002167,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034035,"completed_at":"2026-09-18T22:14:04.296Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 250.002916] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c76949b193e76e4972349d9f","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c76949b193e76e4972349d9f: start","job_status":"start","queue_duration_s":2.907056,"scheduling_latency_s":2.907076}1382gitlab # [ 250.017491] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.329Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c76949b193e76e4972349d9f","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c76949b193e76e4972349d9f: done: 0.031086 sec","job_status":"done","queue_duration_s":2.907056,"scheduling_latency_s":2.907076,"redis_calls":13,"redis_duration_s":0.003405,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000939,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002466,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022386,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031086,"completed_at":"2026-09-18T22:14:04.329Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 250.057306] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.332Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a741edd0461f6efe49c34e8","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a741edd0461f6efe49c34e8: start","job_status":"start","queue_duration_s":2.940575,"scheduling_latency_s":2.940642}1384gitlab # [ 250.070174] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.367Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a741edd0461f6efe49c34e8","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a741edd0461f6efe49c34e8: done: 0.035425 sec","job_status":"done","queue_duration_s":2.940575,"scheduling_latency_s":2.940642,"redis_calls":13,"redis_duration_s":0.003578,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001163,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002415,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035425,"completed_at":"2026-09-18T22:14:04.367Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 250.110560] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.371Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd464b83c8e9e8fc041fc02c","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd464b83c8e9e8fc041fc02c: start","job_status":"start","queue_duration_s":2.979381,"scheduling_latency_s":2.979437}1386gitlab # [ 250.123206] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.405Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd464b83c8e9e8fc041fc02c","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd464b83c8e9e8fc041fc02c: done: 0.03426 sec","job_status":"done","queue_duration_s":2.979381,"scheduling_latency_s":2.979437,"redis_calls":13,"redis_duration_s":0.003133,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001013,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00212,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03426,"completed_at":"2026-09-18T22:14:04.405Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 250.163158] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.407Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f23855f00111da26fd89933","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f23855f00111da26fd89933: start","job_status":"start","queue_duration_s":3.015899,"scheduling_latency_s":3.015921}1388gitlab # [ 250.175773] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f23855f00111da26fd89933","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f23855f00111da26fd89933: done: 0.033466 sec","job_status":"done","queue_duration_s":3.015899,"scheduling_latency_s":3.015921,"redis_calls":13,"redis_duration_s":0.003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000931,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002069,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024881,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033466,"completed_at":"2026-09-18T22:14:04.440Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 250.215442] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.443Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc48351b36d3302828432384","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc48351b36d3302828432384: start","job_status":"start","queue_duration_s":3.051627,"scheduling_latency_s":3.051662}1390gitlab # [ 250.228325] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.477Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc48351b36d3302828432384","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc48351b36d3302828432384: done: 0.03414 sec","job_status":"done","queue_duration_s":3.051627,"scheduling_latency_s":3.051662,"redis_calls":13,"redis_duration_s":0.0032660000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001154,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002112,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023933,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03414,"completed_at":"2026-09-18T22:14:04.477Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391gitlab # [ 250.268273] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.479Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fef145b1e88d0b58f35d69e0","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fef145b1e88d0b58f35d69e0: start","job_status":"start","queue_duration_s":3.087993,"scheduling_latency_s":3.088012}1392gitlab # [ 250.281896] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.511Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fef145b1e88d0b58f35d69e0","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fef145b1e88d0b58f35d69e0: done: 0.031596 sec","job_status":"done","queue_duration_s":3.087993,"scheduling_latency_s":3.088012,"redis_calls":13,"redis_duration_s":0.0028539999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001849,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022655,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031596,"completed_at":"2026-09-18T22:14:04.511Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1393gitlab # [ 250.322871] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.513Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87a83317174ed3cdddeed96b","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87a83317174ed3cdddeed96b: start","job_status":"start","queue_duration_s":3.121977,"scheduling_latency_s":3.121995}1394gitlab # [ 250.335803] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.545Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87a83317174ed3cdddeed96b","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87a83317174ed3cdddeed96b: done: 0.031492 sec","job_status":"done","queue_duration_s":3.121977,"scheduling_latency_s":3.121995,"redis_calls":13,"redis_duration_s":0.0028659999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000939,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001927,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031492,"completed_at":"2026-09-18T22:14:04.545Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 250.377268] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.547Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6fb8a2771168d1621ee09f05","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6fb8a2771168d1621ee09f05: start","job_status":"start","queue_duration_s":3.156228,"scheduling_latency_s":3.156247}1396gitlab # [ 250.389825] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.581Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6fb8a2771168d1621ee09f05","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6fb8a2771168d1621ee09f05: done: 0.033291 sec","job_status":"done","queue_duration_s":3.156228,"scheduling_latency_s":3.156247,"redis_calls":13,"redis_duration_s":0.003053,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001061,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001992,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024233,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033291,"completed_at":"2026-09-18T22:14:04.581Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 250.429775] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44837e0c336a5ca561e1eee7","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44837e0c336a5ca561e1eee7: start","job_status":"start","queue_duration_s":3.191651,"scheduling_latency_s":3.191698}1398gitlab # [ 250.442489] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.617Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44837e0c336a5ca561e1eee7","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44837e0c336a5ca561e1eee7: done: 0.034063 sec","job_status":"done","queue_duration_s":3.191651,"scheduling_latency_s":3.191698,"redis_calls":13,"redis_duration_s":0.0029779999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001041,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001937,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024551,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034063,"completed_at":"2026-09-18T22:14:04.617Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 250.485990] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.619Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5d4ef613261a99bad73c9c0","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5d4ef613261a99bad73c9c0: start","job_status":"start","queue_duration_s":3.228001,"scheduling_latency_s":3.228027}1400gitlab # [ 250.498653] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.654Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5d4ef613261a99bad73c9c0","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5d4ef613261a99bad73c9c0: done: 0.034368 sec","job_status":"done","queue_duration_s":3.228001,"scheduling_latency_s":3.228027,"redis_calls":13,"redis_duration_s":0.003438,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001176,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002262,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025352,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034368,"completed_at":"2026-09-18T22:14:04.653Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 250.538596] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.656Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9ae555bca75e9def9cf8e33","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9ae555bca75e9def9cf8e33: start","job_status":"start","queue_duration_s":3.264616,"scheduling_latency_s":3.264637}1402gitlab # [ 250.551481] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.688Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9ae555bca75e9def9cf8e33","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9ae555bca75e9def9cf8e33: done: 0.032244 sec","job_status":"done","queue_duration_s":3.264616,"scheduling_latency_s":3.264637,"redis_calls":13,"redis_duration_s":0.002857,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00193,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023157,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032244,"completed_at":"2026-09-18T22:14:04.688Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 250.591164] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.691Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e6033628eb75c33a3e56ea3","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e6033628eb75c33a3e56ea3: start","job_status":"start","queue_duration_s":3.299597,"scheduling_latency_s":3.299624}1404gitlab # [ 250.603895] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.726Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e6033628eb75c33a3e56ea3","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e6033628eb75c33a3e56ea3: done: 0.035089 sec","job_status":"done","queue_duration_s":3.299597,"scheduling_latency_s":3.299624,"redis_calls":13,"redis_duration_s":0.0030090000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00111,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001899,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035089,"completed_at":"2026-09-18T22:14:04.726Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405gitlab # [ 250.643732] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.728Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2f2246ea327855fbaccafba","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2f2246ea327855fbaccafba: start","job_status":"start","queue_duration_s":3.337024,"scheduling_latency_s":3.337068}1406gitlab # [ 250.656597] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2f2246ea327855fbaccafba","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2f2246ea327855fbaccafba: done: 0.036 sec","job_status":"done","queue_duration_s":3.337024,"scheduling_latency_s":3.337068,"redis_calls":13,"redis_duration_s":0.003226,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001039,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002187,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026272,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036,"completed_at":"2026-09-18T22:14:04.764Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 250.698377] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.767Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad8666f31930eb2fd796bff4","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad8666f31930eb2fd796bff4: start","job_status":"start","queue_duration_s":3.375707,"scheduling_latency_s":3.375727}1408gitlab # [ 250.711086] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.805Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad8666f31930eb2fd796bff4","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad8666f31930eb2fd796bff4: done: 0.038573 sec","job_status":"done","queue_duration_s":3.375707,"scheduling_latency_s":3.375727,"redis_calls":13,"redis_duration_s":0.003449,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001251,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002198,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038573,"completed_at":"2026-09-18T22:14:04.805Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 250.751850] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.808Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54f856aa9c9bf181468fc329","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54f856aa9c9bf181468fc329: start","job_status":"start","queue_duration_s":3.416706,"scheduling_latency_s":3.416745}1410gitlab # [ 250.764526] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.844Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54f856aa9c9bf181468fc329","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54f856aa9c9bf181468fc329: done: 0.036385 sec","job_status":"done","queue_duration_s":3.416706,"scheduling_latency_s":3.416745,"redis_calls":13,"redis_duration_s":0.0034519999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001189,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002263,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025858,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036385,"completed_at":"2026-09-18T22:14:04.844Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 250.803745] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.847Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74083a775a54487543f36eeb","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74083a775a54487543f36eeb: start","job_status":"start","queue_duration_s":3.456116,"scheduling_latency_s":3.456139}1412gitlab # [ 250.816373] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.882Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74083a775a54487543f36eeb","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74083a775a54487543f36eeb: done: 0.034409 sec","job_status":"done","queue_duration_s":3.456116,"scheduling_latency_s":3.456139,"redis_calls":13,"redis_duration_s":0.0030039999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000949,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002055,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034409,"completed_at":"2026-09-18T22:14:04.882Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 250.856149] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.885Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b6d2a5c33a9d5ae6ecad5f3","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b6d2a5c33a9d5ae6ecad5f3: start","job_status":"start","queue_duration_s":3.493316,"scheduling_latency_s":3.493339}1414gitlab # [ 250.868527] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.919Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b6d2a5c33a9d5ae6ecad5f3","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b6d2a5c33a9d5ae6ecad5f3: done: 0.034203 sec","job_status":"done","queue_duration_s":3.493316,"scheduling_latency_s":3.493339,"redis_calls":13,"redis_duration_s":0.0029649999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001099,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001866,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025453,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034203,"completed_at":"2026-09-18T22:14:04.919Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 250.909187] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.922Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e27f476a6ef79c454f877c00","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e27f476a6ef79c454f877c00: start","job_status":"start","queue_duration_s":3.530603,"scheduling_latency_s":3.530624}1416gitlab # [ 250.921811] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.961Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e27f476a6ef79c454f877c00","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e27f476a6ef79c454f877c00: done: 0.039125 sec","job_status":"done","queue_duration_s":3.530603,"scheduling_latency_s":3.530624,"redis_calls":13,"redis_duration_s":0.003258,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00117,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026546,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.039125,"completed_at":"2026-09-18T22:14:04.961Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 250.960652] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.964Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"155dd393898a2ae3583d576f","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-155dd393898a2ae3583d576f: start","job_status":"start","queue_duration_s":3.572621,"scheduling_latency_s":3.57264}1418gitlab # [ 250.973048] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:04.999Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"155dd393898a2ae3583d576f","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-155dd393898a2ae3583d576f: done: 0.03503 sec","job_status":"done","queue_duration_s":3.572621,"scheduling_latency_s":3.57264,"redis_calls":13,"redis_duration_s":0.003133,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001128,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025912,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03503,"completed_at":"2026-09-18T22:14:04.999Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 251.012125] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:05.003Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe943f67eed2f15e8b684f6f","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe943f67eed2f15e8b684f6f: start","job_status":"start","queue_duration_s":3.611432,"scheduling_latency_s":3.61146}1420gitlab # [ 251.024498] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:05.038Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe943f67eed2f15e8b684f6f","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe943f67eed2f15e8b684f6f: done: 0.035534 sec","job_status":"done","queue_duration_s":3.611432,"scheduling_latency_s":3.61146,"redis_calls":13,"redis_duration_s":0.003921,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001773,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002148,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02673,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035534,"completed_at":"2026-09-18T22:14:05.038Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 251.063854] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:05.041Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a84c0358c2f557ef63501553","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a84c0358c2f557ef63501553: start","job_status":"start","queue_duration_s":3.649757,"scheduling_latency_s":3.649779}1422gitlab # [ 251.076205] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:05.081Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a84c0358c2f557ef63501553","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a84c0358c2f557ef63501553: done: 0.04024 sec","job_status":"done","queue_duration_s":3.649757,"scheduling_latency_s":3.649779,"redis_calls":13,"redis_duration_s":0.0035449999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001148,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002397,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028831,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.04024,"completed_at":"2026-09-18T22:14:05.081Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 251.116655] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:05.084Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91bb87614bfa1f1e3013aa9d","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91bb87614bfa1f1e3013aa9d: start","job_status":"start","queue_duration_s":3.69314,"scheduling_latency_s":3.693166}1424gitlab # [ 251.128797] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:05.129Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91bb87614bfa1f1e3013aa9d","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91bb87614bfa1f1e3013aa9d: done: 0.044772 sec","job_status":"done","queue_duration_s":3.69314,"scheduling_latency_s":3.693166,"redis_calls":13,"redis_duration_s":0.004845,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001441,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003404,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032271,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.044772,"completed_at":"2026-09-18T22:14:05.129Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 251.167828] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:05.132Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4aea8080f85b6bd0d863345c","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4aea8080f85b6bd0d863345c: start","job_status":"start","queue_duration_s":3.74069,"scheduling_latency_s":3.740738}1426gitlab # [ 251.181125] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:05.171Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4aea8080f85b6bd0d863345c","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4aea8080f85b6bd0d863345c: done: 0.039057 sec","job_status":"done","queue_duration_s":3.74069,"scheduling_latency_s":3.740738,"redis_calls":13,"redis_duration_s":0.003215,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001046,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002169,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027317,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.039057,"completed_at":"2026-09-18T22:14:05.171Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 251.219625] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:05.173Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93d896ba5f1f346855291b8a","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93d896ba5f1f346855291b8a: start","job_status":"start","queue_duration_s":3.782093,"scheduling_latency_s":3.782118}1428gitlab # [ 251.232319] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:05.209Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93d896ba5f1f346855291b8a","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93d896ba5f1f346855291b8a: done: 0.035404 sec","job_status":"done","queue_duration_s":3.782093,"scheduling_latency_s":3.782118,"redis_calls":13,"redis_duration_s":0.003102,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001036,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002066,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024841,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035404,"completed_at":"2026-09-18T22:14:05.209Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 251.270847] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:05.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bfe209b148a08b22839be95e","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bfe209b148a08b22839be95e: start","job_status":"start","queue_duration_s":3.819693,"scheduling_latency_s":3.819751}1430gitlab # [ 251.283038] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:05.255Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bfe209b148a08b22839be95e","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bfe209b148a08b22839be95e: done: 0.043294 sec","job_status":"done","queue_duration_s":3.819693,"scheduling_latency_s":3.819751,"redis_calls":13,"redis_duration_s":0.002813,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001032,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001781,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024448,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.043294,"completed_at":"2026-09-18T22:14:05.254Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 251.322367] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:05.257Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9562b095741fac68382835b2","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9562b095741fac68382835b2: start","job_status":"start","queue_duration_s":3.86613,"scheduling_latency_s":3.866154}1432gitlab # [ 251.334603] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:05.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9562b095741fac68382835b2","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9562b095741fac68382835b2: done: 0.036625 sec","job_status":"done","queue_duration_s":3.86613,"scheduling_latency_s":3.866154,"redis_calls":13,"redis_duration_s":0.0034400000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001112,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002328,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036625,"completed_at":"2026-09-18T22:14:05.294Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 251.373006] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:05.297Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b9055f79534aa0046da5c0e","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b9055f79534aa0046da5c0e: start","job_status":"start","queue_duration_s":3.906125,"scheduling_latency_s":3.906148}1434gitlab # [ 251.385006] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:05.332Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b9055f79534aa0046da5c0e","created_at":"2026-09-18T22:14:01.302Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-071e3f9c9a884e4c","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2ac3d17c14080eaefe6afae9aa956760","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:01.391Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b9055f79534aa0046da5c0e: done: 0.034699 sec","job_status":"done","queue_duration_s":3.906125,"scheduling_latency_s":3.906148,"redis_calls":13,"redis_duration_s":0.003223,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001119,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024903,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034699,"completed_at":"2026-09-18T22:14:05.332Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 251.423757] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:05.883Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"ba031ac2d646144405ad4744","created_at":"2026-09-18T22:14:05.864Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"29d54b9be11ee33dd3f588090fa56b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:05.877Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-ba031ac2d646144405ad4744: start","job_status":"start","queue_duration_s":0.00534,"scheduling_latency_s":0.005388}1436gitlab # [ 252.355268] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:06.994Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"ba031ac2d646144405ad4744","created_at":"2026-09-18T22:14:05.864Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"29d54b9be11ee33dd3f588090fa56b0d","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:05.877Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-ba031ac2d646144405ad4744: done: 1.111416 sec","job_status":"done","queue_duration_s":0.00534,"scheduling_latency_s":0.005388,"redis_calls":562,"redis_duration_s":0.620674,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004289,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.616385,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.561097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.111416,"completed_at":"2026-09-18T22:14:06.994Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 252.355700] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:06.996Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"bff425e8d8914c90b69c8367","created_at":"2026-09-18T22:14:05.905Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f93164503cfb21946d4875d2de40e55b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:05.910Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-bff425e8d8914c90b69c8367: start","job_status":"start","queue_duration_s":1.085732,"scheduling_latency_s":1.085763}1438gitlab # [ 252.466858] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.107Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"bff425e8d8914c90b69c8367","created_at":"2026-09-18T22:14:05.905Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f93164503cfb21946d4875d2de40e55b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:05.910Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-bff425e8d8914c90b69c8367: done: 0.110968 sec","job_status":"done","queue_duration_s":1.085732,"scheduling_latency_s":1.085763,"redis_calls":14,"redis_duration_s":0.003287,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.000482,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002153,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000652,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.099264,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.110968,"completed_at":"2026-09-18T22:14:07.106Z","load_balancing_strategy":"primary","db_duration_s":0.00134,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 252.554713] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.108Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"cc45ca0aae180be85539f746","created_at":"2026-09-18T22:14:05.922Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c10d8c237daf836fb0191fb1dd559831","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:05.926Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-cc45ca0aae180be85539f746: start","job_status":"start","queue_duration_s":1.182246,"scheduling_latency_s":1.182267}1440gitlab # [ 252.571905] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.115Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1441gitlab # [ 252.576251] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.122Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"cc45ca0aae180be85539f746","created_at":"2026-09-18T22:14:05.922Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c10d8c237daf836fb0191fb1dd559831","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:05.926Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-cc45ca0aae180be85539f746: done: 0.0138 sec","job_status":"done","queue_duration_s":1.182246,"scheduling_latency_s":1.182267,"redis_calls":7,"redis_duration_s":0.001023,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000744,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0138,"completed_at":"2026-09-18T22:14:07.122Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 252.620261] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.123Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"9f72f7bf29a48ea99f4bb019","created_at":"2026-09-18T22:14:06.039Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"32517c9b7e2b638dc54e30b528442ff6","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:06.057Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-9f72f7bf29a48ea99f4bb019: start","job_status":"start","queue_duration_s":1.065436,"scheduling_latency_s":1.065453}1443gitlab # [ 252.634315] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.169Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"9f72f7bf29a48ea99f4bb019","created_at":"2026-09-18T22:14:06.039Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"32517c9b7e2b638dc54e30b528442ff6","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:06.057Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-9f72f7bf29a48ea99f4bb019: done: 0.04619 sec","job_status":"done","queue_duration_s":1.065436,"scheduling_latency_s":1.065453,"redis_calls":9,"redis_duration_s":0.001437,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000729,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000708,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00056114,"exclusive_lock_hold_duration_s":0.02104044,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.04619,"completed_at":"2026-09-18T22:14:07.169Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023447,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 252.676445] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.170Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"7a027b66273ea66fdc2d9a4f","created_at":"2026-09-18T22:14:06.073Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a6b730b6a694d811f0a9372df6dd87c7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:06.082Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-7a027b66273ea66fdc2d9a4f: start","job_status":"start","queue_duration_s":1.087793,"scheduling_latency_s":1.087809}1445gitlab # [ 252.690839] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.184Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"7a027b66273ea66fdc2d9a4f","created_at":"2026-09-18T22:14:06.073Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a6b730b6a694d811f0a9372df6dd87c7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:06.082Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-7a027b66273ea66fdc2d9a4f: done: 0.014046 sec","job_status":"done","queue_duration_s":1.087793,"scheduling_latency_s":1.087809,"redis_calls":7,"redis_duration_s":0.001055,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000773,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000282,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00839,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014046,"completed_at":"2026-09-18T22:14:07.184Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 252.730527] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.186Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"ae98f6335a0337083729da1f","created_at":"2026-09-18T22:14:06.137Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"981725ab9572aa24192a91b86844afd6","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:06.145Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-ae98f6335a0337083729da1f: start","job_status":"start","queue_duration_s":1.041781,"scheduling_latency_s":1.041798}1447gitlab # [ 252.744741] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.203Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"ae98f6335a0337083729da1f","created_at":"2026-09-18T22:14:06.137Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"981725ab9572aa24192a91b86844afd6","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:06.145Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-ae98f6335a0337083729da1f: done: 0.01676 sec","job_status":"done","queue_duration_s":1.041781,"scheduling_latency_s":1.041798,"redis_calls":9,"redis_duration_s":0.002156,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001553,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000603,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011133,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00045126,"exclusive_lock_hold_duration_s":0.00259058,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.01676,"completed_at":"2026-09-18T22:14:07.203Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000909,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 252.786520] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.204Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"a822979ce86c591a28c7b7c4","created_at":"2026-09-18T22:14:06.175Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:06.185Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-a822979ce86c591a28c7b7c4: start","job_status":"start","queue_duration_s":1.019827,"scheduling_latency_s":1.019844}1449gitlab # [ 252.799918] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.321Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"a822979ce86c591a28c7b7c4","created_at":"2026-09-18T22:14:06.175Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:06.185Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-a822979ce86c591a28c7b7c4: done: 0.116642 sec","job_status":"done","queue_duration_s":1.019827,"scheduling_latency_s":1.019844,"redis_calls":60,"redis_duration_s":0.009598,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.000807,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.008392,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000399,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.089351,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.116642,"completed_at":"2026-09-18T22:14:07.321Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 252.840146] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.322Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"7b61476ba489cd619c1e1670","created_at":"2026-09-18T22:14:06.213Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"072e952f3c8ccb98b899561ea0726c8a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-18T22:14:06.223Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-7b61476ba489cd619c1e1670: start","job_status":"start","queue_duration_s":1.098903,"scheduling_latency_s":1.098922}1451gitlab # [ 252.853190] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.331Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1452gitlab # [ 252.858203] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.336Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"7b61476ba489cd619c1e1670","created_at":"2026-09-18T22:14:06.213Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"072e952f3c8ccb98b899561ea0726c8a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-18T22:14:06.223Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-7b61476ba489cd619c1e1670: done: 0.013536 sec","job_status":"done","queue_duration_s":1.098903,"scheduling_latency_s":1.098922,"redis_calls":7,"redis_duration_s":0.000969,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000684,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000285,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013536,"completed_at":"2026-09-18T22:14:07.336Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 252.896724] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.337Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"068e8829923d4fdbba0dad74","created_at":"2026-09-18T22:14:06.253Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"64cbf6597ee60b1d1a570aed245ebffd","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:06.263Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-068e8829923d4fdbba0dad74: start","job_status":"start","queue_duration_s":1.073485,"scheduling_latency_s":1.073501}1454gitlab # [ 252.910418] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.361Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"068e8829923d4fdbba0dad74","created_at":"2026-09-18T22:14:06.253Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"64cbf6597ee60b1d1a570aed245ebffd","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:06.263Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-068e8829923d4fdbba0dad74: done: 0.023771 sec","job_status":"done","queue_duration_s":1.073485,"scheduling_latency_s":1.073501,"redis_calls":7,"redis_duration_s":0.000992,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000711,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000281,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012578,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023771,"completed_at":"2026-09-18T22:14:07.361Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006327,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 252.950044] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.362Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"2d8725fdd3d905e52026e83f","created_at":"2026-09-18T22:14:06.320Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f5a2fcdf327091f8bf8663662aced6b1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:06.330Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-2d8725fdd3d905e52026e83f: start","job_status":"start","queue_duration_s":1.031907,"scheduling_latency_s":1.031924}1456gitlab # [ 252.965687] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.369Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1457gitlab # [ 252.969049] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.375Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"2d8725fdd3d905e52026e83f","created_at":"2026-09-18T22:14:06.320Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f5a2fcdf327091f8bf8663662aced6b1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:06.330Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-2d8725fdd3d905e52026e83f: done: 0.013425 sec","job_status":"done","queue_duration_s":1.031907,"scheduling_latency_s":1.031924,"redis_calls":7,"redis_duration_s":0.001034,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000735,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000299,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013425,"completed_at":"2026-09-18T22:14:07.375Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 253.009427] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.376Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"e280e5806967aa1b753fd864","created_at":"2026-09-18T22:14:06.364Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"584320d0b66bc38d749f5e69c4e9f39e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:06.375Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-e280e5806967aa1b753fd864: start","job_status":"start","queue_duration_s":1.001159,"scheduling_latency_s":1.001176}1459gitlab # [ 253.023324] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.629Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"e280e5806967aa1b753fd864","created_at":"2026-09-18T22:14:06.364Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"584320d0b66bc38d749f5e69c4e9f39e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:06.375Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-e280e5806967aa1b753fd864: done: 0.252551 sec","job_status":"done","queue_duration_s":1.001159,"scheduling_latency_s":1.001176,"redis_calls":9,"redis_duration_s":0.0015370000000000002,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000809,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000728,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.053,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":129,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.053,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.183763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00048058,"exclusive_lock_hold_duration_s":0.23672904,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.252551,"completed_at":"2026-09-18T22:14:07.629Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.078674,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 253.065385] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.630Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"31f702c87f0cbfa4be9f970f","created_at":"2026-09-18T22:14:06.396Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f09af6efc0ee76164f166e7c884961f","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:06.409Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-31f702c87f0cbfa4be9f970f: start","job_status":"start","queue_duration_s":1.220788,"scheduling_latency_s":1.220809}1461gitlab # [ 253.079266] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.650Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"31f702c87f0cbfa4be9f970f","created_at":"2026-09-18T22:14:06.396Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f09af6efc0ee76164f166e7c884961f","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:06.409Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-31f702c87f0cbfa4be9f970f: done: 0.01972 sec","job_status":"done","queue_duration_s":1.220788,"scheduling_latency_s":1.220809,"redis_calls":7,"redis_duration_s":0.0010890000000000001,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000733,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000356,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.01972,"completed_at":"2026-09-18T22:14:07.650Z","load_balancing_strategy":"primary","db_duration_s":0.004093,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 253.119688] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.651Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"c4622adf79b0a44d90483d60","created_at":"2026-09-18T22:14:06.431Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bb239adca3c8219fccb1d41c25643e05","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:06.456Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-c4622adf79b0a44d90483d60: start","job_status":"start","queue_duration_s":1.194617,"scheduling_latency_s":1.194635}1463gitlab # [ 253.132741] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.673Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"c4622adf79b0a44d90483d60","created_at":"2026-09-18T22:14:06.431Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bb239adca3c8219fccb1d41c25643e05","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:06.456Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-c4622adf79b0a44d90483d60: done: 0.022103 sec","job_status":"done","queue_duration_s":1.194617,"scheduling_latency_s":1.194635,"redis_calls":12,"redis_duration_s":0.001717,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000412,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000285,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000742,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000278,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002583,"duration_s":0.022103,"completed_at":"2026-09-18T22:14:07.673Z","load_balancing_strategy":"primary","db_duration_s":0.000744,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 253.175424] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.674Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"536865956c343e9f7746a466","created_at":"2026-09-18T22:14:06.481Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4ef1b0204fcacb1f27f60cf0a9062a2b","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:06.498Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-536865956c343e9f7746a466: start","job_status":"start","queue_duration_s":1.17597,"scheduling_latency_s":1.175987}1465gitlab # [ 253.189824] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.695Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"536865956c343e9f7746a466","created_at":"2026-09-18T22:14:06.481Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4ef1b0204fcacb1f27f60cf0a9062a2b","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:06.498Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-536865956c343e9f7746a466: done: 0.020773 sec","job_status":"done","queue_duration_s":1.17597,"scheduling_latency_s":1.175987,"redis_calls":10,"redis_duration_s":0.00146,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000854,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000606,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00466818,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.020773,"completed_at":"2026-09-18T22:14:07.695Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002312,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1466gitlab # [ 253.231680] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.696Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"8e6e1f2be69968aa3356bdfe","created_at":"2026-09-18T22:14:06.549Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4e6b34eb255e27930bea3916b27eb45e","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:06.574Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-8e6e1f2be69968aa3356bdfe: start","job_status":"start","queue_duration_s":1.122099,"scheduling_latency_s":1.122116}1467gitlab # [ 253.245782] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.727Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"8e6e1f2be69968aa3356bdfe","created_at":"2026-09-18T22:14:06.549Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4e6b34eb255e27930bea3916b27eb45e","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:06.574Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-8e6e1f2be69968aa3356bdfe: done: 0.030409 sec","job_status":"done","queue_duration_s":1.122099,"scheduling_latency_s":1.122116,"redis_calls":10,"redis_duration_s":0.0016099999999999999,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000304,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001019,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000287,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002464,"duration_s":0.030409,"completed_at":"2026-09-18T22:14:07.727Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005819,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 253.287525] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.728Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"0d195511f5445ab21b91f1bf","created_at":"2026-09-18T22:14:06.621Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"44d13afe4949204e03d3a11191e24b8d","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:06.643Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-0d195511f5445ab21b91f1bf: start","job_status":"start","queue_duration_s":1.084676,"scheduling_latency_s":1.084693}1469gitlab # [ 253.301774] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.754Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"0d195511f5445ab21b91f1bf","created_at":"2026-09-18T22:14:06.621Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"44d13afe4949204e03d3a11191e24b8d","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:06.643Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-0d195511f5445ab21b91f1bf: done: 0.025961 sec","job_status":"done","queue_duration_s":1.084676,"scheduling_latency_s":1.084693,"redis_calls":12,"redis_duration_s":0.001629,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000274,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000732,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000623,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00048834,"exclusive_lock_hold_duration_s":0.0062402199999999994,"duration_s":0.025961,"completed_at":"2026-09-18T22:14:07.754Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00392,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 253.343318] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.755Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"80000f4489e9f74f204ed04b","created_at":"2026-09-18T22:14:06.666Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1fe2404f86d3060edd0c21e717862dec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:06.687Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-80000f4489e9f74f204ed04b: start","job_status":"start","queue_duration_s":1.067813,"scheduling_latency_s":1.067829}1471gitlab # [ 253.357738] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.994Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"80000f4489e9f74f204ed04b","created_at":"2026-09-18T22:14:06.666Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1fe2404f86d3060edd0c21e717862dec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-09-18T22:14:06.687Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-80000f4489e9f74f204ed04b: done: 0.239332 sec","job_status":"done","queue_duration_s":1.067813,"scheduling_latency_s":1.067829,"redis_calls":12,"redis_duration_s":0.002739,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000276,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001215,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001248,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.216817,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00045922,"exclusive_lock_hold_duration_s":0.21663323999999998,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.239332,"completed_at":"2026-09-18T22:14:07.994Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018676,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null}1472gitlab # [ 253.401366] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:07.996Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0e907b6848e70f0991ec9e76","created_at":"2026-09-18T22:14:07.009Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8cf7020f763b4816","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f93164503cfb21946d4875d2de40e55b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.099Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0e907b6848e70f0991ec9e76: start","job_status":"start","queue_duration_s":0.897435,"scheduling_latency_s":0.897456}1473gitlab # [ 253.413431] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.011Z","message":"No existing merge request to be cleaned up."}1474gitlab # [ 253.415038] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.033Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0e907b6848e70f0991ec9e76","created_at":"2026-09-18T22:14:07.009Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8cf7020f763b4816","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f93164503cfb21946d4875d2de40e55b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.099Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0e907b6848e70f0991ec9e76: done: 0.036704 sec","job_status":"done","queue_duration_s":0.897435,"scheduling_latency_s":0.897456,"redis_calls":10,"redis_duration_s":0.003279,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0014,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001879,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036704,"completed_at":"2026-09-18T22:14:08.033Z","load_balancing_strategy":"primary","db_duration_s":0.003658,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1475gitlab # [ 253.452589] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.037Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"03900521c7c4a6d01b90a646","created_at":"2026-09-18T22:14:07.009Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8cf7020f763b4816","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f93164503cfb21946d4875d2de40e55b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.099Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-03900521c7c4a6d01b90a646: start","job_status":"start","queue_duration_s":0.937874,"scheduling_latency_s":0.937921}1476gitlab # [ 253.464392] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.063Z","message":"No existing merge request to be cleaned up."}1477gitlab # [ 253.465967] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.080Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"03900521c7c4a6d01b90a646","created_at":"2026-09-18T22:14:07.009Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8cf7020f763b4816","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f93164503cfb21946d4875d2de40e55b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.099Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-03900521c7c4a6d01b90a646: done: 0.043302 sec","job_status":"done","queue_duration_s":0.937874,"scheduling_latency_s":0.937921,"redis_calls":10,"redis_duration_s":0.0027419999999999996,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001197,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001545,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043302,"completed_at":"2026-09-18T22:14:08.080Z","load_balancing_strategy":"primary","db_duration_s":0.006945,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 253.503724] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.082Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d1c43164ef8682b9035aa667","created_at":"2026-09-18T22:14:07.009Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8cf7020f763b4816","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f93164503cfb21946d4875d2de40e55b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.099Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d1c43164ef8682b9035aa667: start","job_status":"start","queue_duration_s":0.98342,"scheduling_latency_s":0.983452}1479gitlab # [ 253.515806] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.102Z","message":"No existing merge request to be cleaned up."}1480gitlab # [ 253.517514] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.116Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d1c43164ef8682b9035aa667","created_at":"2026-09-18T22:14:07.009Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8cf7020f763b4816","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f93164503cfb21946d4875d2de40e55b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.099Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d1c43164ef8682b9035aa667: done: 0.034358 sec","job_status":"done","queue_duration_s":0.98342,"scheduling_latency_s":0.983452,"redis_calls":10,"redis_duration_s":0.002458,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001045,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001413,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024322,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034358,"completed_at":"2026-09-18T22:14:08.116Z","load_balancing_strategy":"primary","db_duration_s":0.003197,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481gitlab # [ 253.554628] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.119Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8012664d6eeab24dae35bf9c","created_at":"2026-09-18T22:14:07.009Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8cf7020f763b4816","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f93164503cfb21946d4875d2de40e55b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.099Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8012664d6eeab24dae35bf9c: start","job_status":"start","queue_duration_s":1.019775,"scheduling_latency_s":1.019805}1482gitlab # [ 253.566694] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.136Z","message":"No existing merge request to be cleaned up."}1483gitlab # [ 253.568330] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.148Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8012664d6eeab24dae35bf9c","created_at":"2026-09-18T22:14:07.009Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8cf7020f763b4816","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f93164503cfb21946d4875d2de40e55b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.099Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8012664d6eeab24dae35bf9c: done: 0.029699 sec","job_status":"done","queue_duration_s":1.019775,"scheduling_latency_s":1.019805,"redis_calls":10,"redis_duration_s":0.001919,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000828,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001091,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020304,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029699,"completed_at":"2026-09-18T22:14:08.148Z","load_balancing_strategy":"primary","db_duration_s":0.002741,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 253.606595] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.150Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ec5b78f354bd4e4978f8af0","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ec5b78f354bd4e4978f8af0: start","job_status":"start","queue_duration_s":0.837467,"scheduling_latency_s":0.837489}1485gitlab # [ 253.618696] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ec5b78f354bd4e4978f8af0","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ec5b78f354bd4e4978f8af0: done: 0.020274 sec","job_status":"done","queue_duration_s":0.837467,"scheduling_latency_s":0.837489,"redis_calls":13,"redis_duration_s":0.002196,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000697,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001499,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020274,"completed_at":"2026-09-18T22:14:08.170Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 253.656717] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.172Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ce7672af20e1df8b3104868","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ce7672af20e1df8b3104868: start","job_status":"start","queue_duration_s":0.859136,"scheduling_latency_s":0.859155}1487gitlab # [ 253.668679] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.189Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ce7672af20e1df8b3104868","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ce7672af20e1df8b3104868: done: 0.01705 sec","job_status":"done","queue_duration_s":0.859136,"scheduling_latency_s":0.859155,"redis_calls":13,"redis_duration_s":0.0016510000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000603,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001048,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011814,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01705,"completed_at":"2026-09-18T22:14:08.188Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 253.706456] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.190Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d10b3cecfc7721448c76e69","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d10b3cecfc7721448c76e69: start","job_status":"start","queue_duration_s":0.877456,"scheduling_latency_s":0.877473}1489gitlab # [ 253.718595] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.205Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d10b3cecfc7721448c76e69","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d10b3cecfc7721448c76e69: done: 0.015447 sec","job_status":"done","queue_duration_s":0.877456,"scheduling_latency_s":0.877473,"redis_calls":13,"redis_duration_s":0.0015140000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000973,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010434,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015447,"completed_at":"2026-09-18T22:14:08.205Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 253.756847] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.207Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d21b60b07bf1fa10bf698891","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d21b60b07bf1fa10bf698891: start","job_status":"start","queue_duration_s":0.894293,"scheduling_latency_s":0.894309}1491gitlab # [ 253.768897] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.221Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d21b60b07bf1fa10bf698891","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d21b60b07bf1fa10bf698891: done: 0.014845 sec","job_status":"done","queue_duration_s":0.894293,"scheduling_latency_s":0.894309,"redis_calls":13,"redis_duration_s":0.001738,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001177,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010379,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014845,"completed_at":"2026-09-18T22:14:08.221Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 253.808144] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.223Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e655cfef23b5d5d23813e2d","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e655cfef23b5d5d23813e2d: start","job_status":"start","queue_duration_s":0.91047,"scheduling_latency_s":0.910486}1493gitlab # [ 253.820174] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.238Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e655cfef23b5d5d23813e2d","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e655cfef23b5d5d23813e2d: done: 0.015026 sec","job_status":"done","queue_duration_s":0.91047,"scheduling_latency_s":0.910486,"redis_calls":13,"redis_duration_s":0.001442,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015026,"completed_at":"2026-09-18T22:14:08.238Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 253.859338] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.239Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b5b4a1e914833bf0deca96c","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b5b4a1e914833bf0deca96c: start","job_status":"start","queue_duration_s":0.926642,"scheduling_latency_s":0.926659}1495gitlab # [ 253.871543] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.257Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b5b4a1e914833bf0deca96c","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b5b4a1e914833bf0deca96c: done: 0.018496 sec","job_status":"done","queue_duration_s":0.926642,"scheduling_latency_s":0.926659,"redis_calls":13,"redis_duration_s":0.001469,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000929,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010256,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018496,"completed_at":"2026-09-18T22:14:08.257Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 253.910623] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.259Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77ebc00058a9d07f43626452","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77ebc00058a9d07f43626452: start","job_status":"start","queue_duration_s":0.946371,"scheduling_latency_s":0.946573}1497gitlab # [ 253.923074] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77ebc00058a9d07f43626452","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77ebc00058a9d07f43626452: done: 0.015114 sec","job_status":"done","queue_duration_s":0.946371,"scheduling_latency_s":0.946573,"redis_calls":13,"redis_duration_s":0.0014659999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010293,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015114,"completed_at":"2026-09-18T22:14:08.274Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 253.961781] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.275Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3ab5691f90f7de729aed734","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3ab5691f90f7de729aed734: start","job_status":"start","queue_duration_s":0.962634,"scheduling_latency_s":0.96265}1499gitlab # [ 253.974348] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.290Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3ab5691f90f7de729aed734","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3ab5691f90f7de729aed734: done: 0.014621 sec","job_status":"done","queue_duration_s":0.962634,"scheduling_latency_s":0.96265,"redis_calls":13,"redis_duration_s":0.001441,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000919,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014621,"completed_at":"2026-09-18T22:14:08.290Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 254.013498] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.291Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03f6bdbeee37761ed6303488","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03f6bdbeee37761ed6303488: start","job_status":"start","queue_duration_s":0.978398,"scheduling_latency_s":0.978414}1501gitlab # [ 254.025711] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.305Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03f6bdbeee37761ed6303488","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03f6bdbeee37761ed6303488: done: 0.01451 sec","job_status":"done","queue_duration_s":0.978398,"scheduling_latency_s":0.978414,"redis_calls":13,"redis_duration_s":0.0014190000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000892,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010171,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01451,"completed_at":"2026-09-18T22:14:08.305Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502gitlab # [ 254.064671] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09806f92e5ab22c5aecc12ac","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09806f92e5ab22c5aecc12ac: start","job_status":"start","queue_duration_s":0.994046,"scheduling_latency_s":0.994063}1503gitlab # [ 254.076540] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.321Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09806f92e5ab22c5aecc12ac","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09806f92e5ab22c5aecc12ac: done: 0.014551 sec","job_status":"done","queue_duration_s":0.994046,"scheduling_latency_s":0.994063,"redis_calls":13,"redis_duration_s":0.001509,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000975,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009879,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014551,"completed_at":"2026-09-18T22:14:08.321Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 254.115052] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.322Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7467e979c19a812566aaad7","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7467e979c19a812566aaad7: start","job_status":"start","queue_duration_s":1.010086,"scheduling_latency_s":1.010101}1505gitlab # [ 254.127282] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7467e979c19a812566aaad7","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7467e979c19a812566aaad7: done: 0.015039 sec","job_status":"done","queue_duration_s":1.010086,"scheduling_latency_s":1.010101,"redis_calls":13,"redis_duration_s":0.0016680000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000756,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010384,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015039,"completed_at":"2026-09-18T22:14:08.337Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506gitlab # [ 254.165612] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.339Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6de98f2098871b69252e4d20","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6de98f2098871b69252e4d20: start","job_status":"start","queue_duration_s":1.026348,"scheduling_latency_s":1.026363}1507gitlab # [ 254.177712] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.354Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6de98f2098871b69252e4d20","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6de98f2098871b69252e4d20: done: 0.014868 sec","job_status":"done","queue_duration_s":1.026348,"scheduling_latency_s":1.026363,"redis_calls":13,"redis_duration_s":0.001486,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000948,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014868,"completed_at":"2026-09-18T22:14:08.353Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508gitlab # [ 254.217039] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46b259af6b957d4de13e6f73","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46b259af6b957d4de13e6f73: start","job_status":"start","queue_duration_s":1.042418,"scheduling_latency_s":1.042434}1509gitlab # [ 254.229007] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.369Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46b259af6b957d4de13e6f73","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46b259af6b957d4de13e6f73: done: 0.014319 sec","job_status":"done","queue_duration_s":1.042418,"scheduling_latency_s":1.042434,"redis_calls":13,"redis_duration_s":0.0014880000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014319,"completed_at":"2026-09-18T22:14:08.369Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510gitlab # [ 254.267643] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5ccd79c11d673eb610e4125","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5ccd79c11d673eb610e4125: start","job_status":"start","queue_duration_s":1.057784,"scheduling_latency_s":1.057799}1511gitlab # [ 254.280020] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.384Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5ccd79c11d673eb610e4125","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5ccd79c11d673eb610e4125: done: 0.014166 sec","job_status":"done","queue_duration_s":1.057784,"scheduling_latency_s":1.057799,"redis_calls":13,"redis_duration_s":0.001396,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000892,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009677,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014166,"completed_at":"2026-09-18T22:14:08.384Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1512gitlab # [ 254.318118] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.386Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c8599a96419c936cb0f406c","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c8599a96419c936cb0f406c: start","job_status":"start","queue_duration_s":1.073294,"scheduling_latency_s":1.07331}1513gitlab # [ 254.330270] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.400Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c8599a96419c936cb0f406c","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c8599a96419c936cb0f406c: done: 0.014129 sec","job_status":"done","queue_duration_s":1.073294,"scheduling_latency_s":1.07331,"redis_calls":13,"redis_duration_s":0.001629,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000733,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000896,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014129,"completed_at":"2026-09-18T22:14:08.400Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1514gitlab # [ 254.368963] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.401Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60533baaa6949eb4a2f9a3b4","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60533baaa6949eb4a2f9a3b4: start","job_status":"start","queue_duration_s":1.088495,"scheduling_latency_s":1.08851}1515gitlab # [ 254.381105] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.415Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60533baaa6949eb4a2f9a3b4","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60533baaa6949eb4a2f9a3b4: done: 0.014218 sec","job_status":"done","queue_duration_s":1.088495,"scheduling_latency_s":1.08851,"redis_calls":13,"redis_duration_s":0.001431,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000914,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014218,"completed_at":"2026-09-18T22:14:08.415Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1516gitlab # [ 254.420152] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e3311fd327a0fa5e3dd705e","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e3311fd327a0fa5e3dd705e: start","job_status":"start","queue_duration_s":1.103772,"scheduling_latency_s":1.103787}1517gitlab # [ 254.432202] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.431Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e3311fd327a0fa5e3dd705e","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e3311fd327a0fa5e3dd705e: done: 0.015315 sec","job_status":"done","queue_duration_s":1.103772,"scheduling_latency_s":1.103787,"redis_calls":13,"redis_duration_s":0.001739,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000783,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010719,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015315,"completed_at":"2026-09-18T22:14:08.431Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1518gitlab # [ 254.470208] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.433Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c39203a7d413828277b30703","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c39203a7d413828277b30703: start","job_status":"start","queue_duration_s":1.120238,"scheduling_latency_s":1.120254}1519gitlab # [ 254.482428] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.447Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c39203a7d413828277b30703","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c39203a7d413828277b30703: done: 0.01473 sec","job_status":"done","queue_duration_s":1.120238,"scheduling_latency_s":1.120254,"redis_calls":13,"redis_duration_s":0.001545,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01473,"completed_at":"2026-09-18T22:14:08.447Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1520gitlab # [ 254.520386] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.448Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ae53ea13879c867c2666c5c","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ae53ea13879c867c2666c5c: start","job_status":"start","queue_duration_s":1.136118,"scheduling_latency_s":1.136133}1521gitlab # [ 254.532472] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.463Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ae53ea13879c867c2666c5c","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ae53ea13879c867c2666c5c: done: 0.01433 sec","job_status":"done","queue_duration_s":1.136118,"scheduling_latency_s":1.136133,"redis_calls":13,"redis_duration_s":0.00144,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01433,"completed_at":"2026-09-18T22:14:08.463Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1522gitlab # [ 254.570819] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.464Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6da11471bf59f60d79f12548","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6da11471bf59f60d79f12548: start","job_status":"start","queue_duration_s":1.151495,"scheduling_latency_s":1.151511}1523gitlab # [ 254.583020] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.478Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6da11471bf59f60d79f12548","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6da11471bf59f60d79f12548: done: 0.014347 sec","job_status":"done","queue_duration_s":1.151495,"scheduling_latency_s":1.151511,"redis_calls":13,"redis_duration_s":0.00141,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014347,"completed_at":"2026-09-18T22:14:08.478Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1524gitlab # [ 254.622439] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.479Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ccc3365b50cc19af2435d12","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ccc3365b50cc19af2435d12: start","job_status":"start","queue_duration_s":1.166908,"scheduling_latency_s":1.166924}1525gitlab # [ 254.634634] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.493Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ccc3365b50cc19af2435d12","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ccc3365b50cc19af2435d12: done: 0.014147 sec","job_status":"done","queue_duration_s":1.166908,"scheduling_latency_s":1.166924,"redis_calls":13,"redis_duration_s":0.001426,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009909,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014147,"completed_at":"2026-09-18T22:14:08.493Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1526gitlab # [ 254.672674] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.495Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c89cb153b3dcedf1f8c3414","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c89cb153b3dcedf1f8c3414: start","job_status":"start","queue_duration_s":1.182166,"scheduling_latency_s":1.182182}1527gitlab # [ 254.684809] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.510Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c89cb153b3dcedf1f8c3414","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c89cb153b3dcedf1f8c3414: done: 0.015951 sec","job_status":"done","queue_duration_s":1.182166,"scheduling_latency_s":1.182182,"redis_calls":13,"redis_duration_s":0.001575,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000577,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010531,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015951,"completed_at":"2026-09-18T22:14:08.510Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1528gitlab # [ 254.723086] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.512Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"872bd46e47214c68c69a1507","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-872bd46e47214c68c69a1507: start","job_status":"start","queue_duration_s":1.199188,"scheduling_latency_s":1.199204}1529gitlab # [ 254.735327] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.527Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"872bd46e47214c68c69a1507","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-872bd46e47214c68c69a1507: done: 0.01554 sec","job_status":"done","queue_duration_s":1.199188,"scheduling_latency_s":1.199204,"redis_calls":13,"redis_duration_s":0.001801,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001243,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010426,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01554,"completed_at":"2026-09-18T22:14:08.527Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1530gitlab # [ 254.773460] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2093bc7e43025abff3d77a2d","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2093bc7e43025abff3d77a2d: start","job_status":"start","queue_duration_s":1.216094,"scheduling_latency_s":1.216111}1531gitlab # [ 254.785604] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2093bc7e43025abff3d77a2d","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2093bc7e43025abff3d77a2d: done: 0.015377 sec","job_status":"done","queue_duration_s":1.216094,"scheduling_latency_s":1.216111,"redis_calls":13,"redis_duration_s":0.0014520000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000919,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010327,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015377,"completed_at":"2026-09-18T22:14:08.544Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1532gitlab # [ 254.824842] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.545Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ccbe41aafcff487caa01cb09","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ccbe41aafcff487caa01cb09: start","job_status":"start","queue_duration_s":1.232611,"scheduling_latency_s":1.232627}1533gitlab # [ 254.836772] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.560Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ccbe41aafcff487caa01cb09","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ccbe41aafcff487caa01cb09: done: 0.014975 sec","job_status":"done","queue_duration_s":1.232611,"scheduling_latency_s":1.232627,"redis_calls":13,"redis_duration_s":0.001447,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014975,"completed_at":"2026-09-18T22:14:08.560Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1534gitlab # [ 254.875107] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.561Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"369980cdfe7b4fa58472bb05","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-369980cdfe7b4fa58472bb05: start","job_status":"start","queue_duration_s":1.248997,"scheduling_latency_s":1.249013}1535gitlab # [ 254.887361] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.577Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"369980cdfe7b4fa58472bb05","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-369980cdfe7b4fa58472bb05: done: 0.015564 sec","job_status":"done","queue_duration_s":1.248997,"scheduling_latency_s":1.249013,"redis_calls":13,"redis_duration_s":0.0015249999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00057,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000955,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010881,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015564,"completed_at":"2026-09-18T22:14:08.577Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1536gitlab # [ 254.925841] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.578Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"624bf55c3e3dc0085d639188","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-624bf55c3e3dc0085d639188: start","job_status":"start","queue_duration_s":1.266051,"scheduling_latency_s":1.266068}1537gitlab # [ 254.938021] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.594Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"624bf55c3e3dc0085d639188","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-624bf55c3e3dc0085d639188: done: 0.015284 sec","job_status":"done","queue_duration_s":1.266051,"scheduling_latency_s":1.266068,"redis_calls":13,"redis_duration_s":0.001539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000563,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010918,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015284,"completed_at":"2026-09-18T22:14:08.594Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1538gitlab # [ 254.976328] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.595Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38d2582fd44a7fa0644b9bd2","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38d2582fd44a7fa0644b9bd2: start","job_status":"start","queue_duration_s":1.282833,"scheduling_latency_s":1.28285}1539gitlab # [ 254.988731] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.611Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38d2582fd44a7fa0644b9bd2","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38d2582fd44a7fa0644b9bd2: done: 0.015414 sec","job_status":"done","queue_duration_s":1.282833,"scheduling_latency_s":1.28285,"redis_calls":13,"redis_duration_s":0.001507,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000948,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015414,"completed_at":"2026-09-18T22:14:08.611Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1540gitlab # [ 255.028176] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.612Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3563a022037dc6a6c2764f54","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3563a022037dc6a6c2764f54: start","job_status":"start","queue_duration_s":1.299559,"scheduling_latency_s":1.299574}1541gitlab # [ 255.040275] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.627Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3563a022037dc6a6c2764f54","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3563a022037dc6a6c2764f54: done: 0.014991 sec","job_status":"done","queue_duration_s":1.299559,"scheduling_latency_s":1.299574,"redis_calls":13,"redis_duration_s":0.001478,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000948,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014991,"completed_at":"2026-09-18T22:14:08.627Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1542gitlab # [ 255.078653] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.629Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbb2dcfc3e1710a09604b107","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbb2dcfc3e1710a09604b107: start","job_status":"start","queue_duration_s":1.316362,"scheduling_latency_s":1.31638}1543gitlab # [ 255.091019] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.644Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbb2dcfc3e1710a09604b107","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbb2dcfc3e1710a09604b107: done: 0.015496 sec","job_status":"done","queue_duration_s":1.316362,"scheduling_latency_s":1.31638,"redis_calls":13,"redis_duration_s":0.001904,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000961,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015496,"completed_at":"2026-09-18T22:14:08.644Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1544gitlab # [ 255.129431] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.645Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"908a576ebb4101b396712c5d","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-908a576ebb4101b396712c5d: start","job_status":"start","queue_duration_s":1.332922,"scheduling_latency_s":1.332938}1545gitlab # [ 255.141623] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.662Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"908a576ebb4101b396712c5d","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-908a576ebb4101b396712c5d: done: 0.016512 sec","job_status":"done","queue_duration_s":1.332922,"scheduling_latency_s":1.332938,"redis_calls":13,"redis_duration_s":0.001545,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001015,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011361,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016512,"completed_at":"2026-09-18T22:14:08.662Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1546gitlab # [ 255.180000] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.663Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"875a3c39e672571f2a7fe192","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-875a3c39e672571f2a7fe192: start","job_status":"start","queue_duration_s":1.350555,"scheduling_latency_s":1.350571}1547gitlab # [ 255.192008] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.679Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"875a3c39e672571f2a7fe192","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-875a3c39e672571f2a7fe192: done: 0.015768 sec","job_status":"done","queue_duration_s":1.350555,"scheduling_latency_s":1.350571,"redis_calls":13,"redis_duration_s":0.001886,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001368,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010549,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015768,"completed_at":"2026-09-18T22:14:08.679Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1548gitlab # [ 255.232122] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.680Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2634613be44d439a8d1248a5","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2634613be44d439a8d1248a5: start","job_status":"start","queue_duration_s":1.367364,"scheduling_latency_s":1.367379}1549gitlab # [ 255.244060] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2634613be44d439a8d1248a5","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2634613be44d439a8d1248a5: done: 0.016131 sec","job_status":"done","queue_duration_s":1.367364,"scheduling_latency_s":1.367379,"redis_calls":13,"redis_duration_s":0.001495,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010839,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016131,"completed_at":"2026-09-18T22:14:08.696Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1550gitlab # [ 255.282729] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.697Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa96d7303bfdcaf28c75a5b0","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa96d7303bfdcaf28c75a5b0: start","job_status":"start","queue_duration_s":1.384567,"scheduling_latency_s":1.384583}1551gitlab # [ 255.295135] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.713Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa96d7303bfdcaf28c75a5b0","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa96d7303bfdcaf28c75a5b0: done: 0.016305 sec","job_status":"done","queue_duration_s":1.384567,"scheduling_latency_s":1.384583,"redis_calls":13,"redis_duration_s":0.0015429999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000557,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016305,"completed_at":"2026-09-18T22:14:08.713Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1552gitlab # [ 255.333630] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.714Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"438f04f9750e12df89f3aa05","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-438f04f9750e12df89f3aa05: start","job_status":"start","queue_duration_s":1.401983,"scheduling_latency_s":1.401999}1553gitlab # [ 255.346298] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"438f04f9750e12df89f3aa05","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-438f04f9750e12df89f3aa05: done: 0.01541 sec","job_status":"done","queue_duration_s":1.401983,"scheduling_latency_s":1.401999,"redis_calls":13,"redis_duration_s":0.001534,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00057,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000964,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01541,"completed_at":"2026-09-18T22:14:08.730Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1554gitlab # [ 255.388674] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.731Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d33e188e16d7d2089a77ad22","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d33e188e16d7d2089a77ad22: start","job_status":"start","queue_duration_s":1.418537,"scheduling_latency_s":1.418553}1555gitlab # [ 255.401120] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.745Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d33e188e16d7d2089a77ad22","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d33e188e16d7d2089a77ad22: done: 0.014189 sec","job_status":"done","queue_duration_s":1.418537,"scheduling_latency_s":1.418553,"redis_calls":13,"redis_duration_s":0.001467,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009791,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014189,"completed_at":"2026-09-18T22:14:08.745Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1556gitlab # [ 255.440960] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.746Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e11dcca305ef47dfe32723ee","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e11dcca305ef47dfe32723ee: start","job_status":"start","queue_duration_s":1.433808,"scheduling_latency_s":1.433823}1557gitlab # [ 255.453245] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.760Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e11dcca305ef47dfe32723ee","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e11dcca305ef47dfe32723ee: done: 0.013825 sec","job_status":"done","queue_duration_s":1.433808,"scheduling_latency_s":1.433823,"redis_calls":13,"redis_duration_s":0.001413,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000909,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013825,"completed_at":"2026-09-18T22:14:08.760Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1558gitlab # [ 255.492378] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.761Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"edef5b91a11b7b6c517ebbe4","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-edef5b91a11b7b6c517ebbe4: start","job_status":"start","queue_duration_s":1.448698,"scheduling_latency_s":1.448714}1559gitlab # [ 255.504546] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.775Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"edef5b91a11b7b6c517ebbe4","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-edef5b91a11b7b6c517ebbe4: done: 0.013855 sec","job_status":"done","queue_duration_s":1.448698,"scheduling_latency_s":1.448714,"redis_calls":13,"redis_duration_s":0.0014320000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009576,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013855,"completed_at":"2026-09-18T22:14:08.775Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1560gitlab # [ 255.542740] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1861e45efa80ac79b0027d44","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1861e45efa80ac79b0027d44: start","job_status":"start","queue_duration_s":1.463626,"scheduling_latency_s":1.463642}1561gitlab # [ 255.555383] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.790Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1861e45efa80ac79b0027d44","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1861e45efa80ac79b0027d44: done: 0.013836 sec","job_status":"done","queue_duration_s":1.463626,"scheduling_latency_s":1.463642,"redis_calls":13,"redis_duration_s":0.001422,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009605,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013836,"completed_at":"2026-09-18T22:14:08.790Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1562gitlab # [ 255.594031] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.791Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b9cc6422fb97196730394ce","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b9cc6422fb97196730394ce: start","job_status":"start","queue_duration_s":1.47854,"scheduling_latency_s":1.478557}1563gitlab # [ 255.606361] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.805Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b9cc6422fb97196730394ce","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b9cc6422fb97196730394ce: done: 0.013842 sec","job_status":"done","queue_duration_s":1.47854,"scheduling_latency_s":1.478557,"redis_calls":13,"redis_duration_s":0.001409,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000893,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013842,"completed_at":"2026-09-18T22:14:08.805Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1564gitlab # [ 255.646744] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.806Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b959cf989aab860278e72906","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b959cf989aab860278e72906: start","job_status":"start","queue_duration_s":1.493452,"scheduling_latency_s":1.493469}1565gitlab # [ 255.659004] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.820Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b959cf989aab860278e72906","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b959cf989aab860278e72906: done: 0.014187 sec","job_status":"done","queue_duration_s":1.493452,"scheduling_latency_s":1.493469,"redis_calls":13,"redis_duration_s":0.001459,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009792,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014187,"completed_at":"2026-09-18T22:14:08.820Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1566gitlab # [ 255.697770] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.821Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b097d17cbf4225adfae5a56d","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b097d17cbf4225adfae5a56d: start","job_status":"start","queue_duration_s":1.508806,"scheduling_latency_s":1.508821}1567gitlab # [ 255.710102] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.836Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b097d17cbf4225adfae5a56d","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b097d17cbf4225adfae5a56d: done: 0.014434 sec","job_status":"done","queue_duration_s":1.508806,"scheduling_latency_s":1.508821,"redis_calls":13,"redis_duration_s":0.0017079999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001183,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009893,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014434,"completed_at":"2026-09-18T22:14:08.836Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1568gitlab # [ 255.748928] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.837Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c92efe72642a7e86349dba9c","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c92efe72642a7e86349dba9c: start","job_status":"start","queue_duration_s":1.524379,"scheduling_latency_s":1.524396}1569gitlab # [ 255.761245] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c92efe72642a7e86349dba9c","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c92efe72642a7e86349dba9c: done: 0.013818 sec","job_status":"done","queue_duration_s":1.524379,"scheduling_latency_s":1.524396,"redis_calls":13,"redis_duration_s":0.001421,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000885,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009562,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013818,"completed_at":"2026-09-18T22:14:08.850Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1570gitlab # [ 255.799905] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.852Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbddce66af4068bdc34286cb","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbddce66af4068bdc34286cb: start","job_status":"start","queue_duration_s":1.539297,"scheduling_latency_s":1.539313}1571gitlab # [ 255.812432] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbddce66af4068bdc34286cb","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbddce66af4068bdc34286cb: done: 0.013815 sec","job_status":"done","queue_duration_s":1.539297,"scheduling_latency_s":1.539313,"redis_calls":13,"redis_duration_s":0.001403,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000895,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009583,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013815,"completed_at":"2026-09-18T22:14:08.865Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1572gitlab # [ 255.852304] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.867Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bba1b2a87a2718596cae3b31","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bba1b2a87a2718596cae3b31: start","job_status":"start","queue_duration_s":1.554205,"scheduling_latency_s":1.554222}1573gitlab # [ 255.864202] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.881Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bba1b2a87a2718596cae3b31","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bba1b2a87a2718596cae3b31: done: 0.013972 sec","job_status":"done","queue_duration_s":1.554205,"scheduling_latency_s":1.554222,"redis_calls":13,"redis_duration_s":0.001498,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000581,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009632,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013972,"completed_at":"2026-09-18T22:14:08.880Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1574gitlab # [ 255.902913] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.882Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eaa633adbfcb4e8c9f5435f8","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eaa633adbfcb4e8c9f5435f8: start","job_status":"start","queue_duration_s":1.569343,"scheduling_latency_s":1.56936}1575gitlab # [ 255.915501] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.896Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eaa633adbfcb4e8c9f5435f8","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eaa633adbfcb4e8c9f5435f8: done: 0.013971 sec","job_status":"done","queue_duration_s":1.569343,"scheduling_latency_s":1.56936,"redis_calls":13,"redis_duration_s":0.0014060000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000892,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009649,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013971,"completed_at":"2026-09-18T22:14:08.896Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1576gitlab # [ 255.954471] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71d3083be7c1fa77ccaf6a54","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71d3083be7c1fa77ccaf6a54: start","job_status":"start","queue_duration_s":1.584488,"scheduling_latency_s":1.584504}1577gitlab # [ 255.966601] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.911Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71d3083be7c1fa77ccaf6a54","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71d3083be7c1fa77ccaf6a54: done: 0.013728 sec","job_status":"done","queue_duration_s":1.584488,"scheduling_latency_s":1.584504,"redis_calls":13,"redis_duration_s":0.0014299999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013728,"completed_at":"2026-09-18T22:14:08.910Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1578gitlab # [ 256.005314] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.912Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b50a14a99a4f42ed749f112","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b50a14a99a4f42ed749f112: start","job_status":"start","queue_duration_s":1.599299,"scheduling_latency_s":1.599315}1579gitlab # [ 256.017693] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.925Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b50a14a99a4f42ed749f112","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b50a14a99a4f42ed749f112: done: 0.013863 sec","job_status":"done","queue_duration_s":1.599299,"scheduling_latency_s":1.599315,"redis_calls":13,"redis_duration_s":0.001412,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000893,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009567,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013863,"completed_at":"2026-09-18T22:14:08.925Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1580gitlab # [ 256.057065] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.927Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0128203e6116b0d5160abdd5","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0128203e6116b0d5160abdd5: start","job_status":"start","queue_duration_s":1.614291,"scheduling_latency_s":1.614306}1581gitlab # [ 256.069305] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0128203e6116b0d5160abdd5","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0128203e6116b0d5160abdd5: done: 0.014315 sec","job_status":"done","queue_duration_s":1.614291,"scheduling_latency_s":1.614306,"redis_calls":13,"redis_duration_s":0.00144,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009774,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014315,"completed_at":"2026-09-18T22:14:08.941Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1582gitlab # [ 256.108235] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.942Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35aa1bd021324624fc42d458","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35aa1bd021324624fc42d458: start","job_status":"start","queue_duration_s":1.629714,"scheduling_latency_s":1.62973}1583gitlab # [ 256.120177] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:14:08.956Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35aa1bd021324624fc42d458","created_at":"2026-09-18T22:14:07.214Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-8054c8aa8a5b43b3","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"787c4b0eca2757f9215f1b8acdf5424f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:14:07.312Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35aa1bd021324624fc42d458: done: 0.014198 sec","job_status":"done","queue_duration_s":1.629714,"scheduling_latency_s":1.62973,"redis_calls":13,"redis_duration_s":0.0014810000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014198,"completed_at":"2026-09-18T22:14:08.956Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1584gitlab # [ 283.773313] setup-gitlab-start[3030]: W, [2026-09-18T22:14:38.411729 #3030] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1585gitlab # [ 309.461377] redis[789]: 10 changes in 300 seconds. Saving...1586gitlab # [ 309.465232] redis[789]: Background saving started by pid 33281587gitlab # [ 309.477051] redis[3328]: BGSAVE done, 431 keys saved, 0 keys skipped, 114947 bytes written.1588gitlab # [ 309.489450] redis[3328]: DB saved on disk1589gitlab # [ 309.492205] redis[3328]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB1590gitlab # [ 309.511419] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:04.150Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"75633dd2b38e77c8a96c7117","created_at":"2026-09-18T22:15:04.043Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a8684330eb31f7b9aa53cc28324ccd9","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.146Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-75633dd2b38e77c8a96c7117: start","job_status":"start","queue_duration_s":0.003619,"scheduling_latency_s":0.003683}1591gitlab # [ 309.563472] redis[789]: Background saving terminated with success1592gitlab # [ 309.720351] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:04.359Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"75633dd2b38e77c8a96c7117","created_at":"2026-09-18T22:15:04.043Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a8684330eb31f7b9aa53cc28324ccd9","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.146Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-75633dd2b38e77c8a96c7117: done: 0.209481 sec","job_status":"done","queue_duration_s":0.003619,"scheduling_latency_s":0.003683,"redis_calls":20,"redis_duration_s":0.029448000000000002,"redis_read_bytes":1161,"redis_write_bytes":1785,"redis_feature_flag_calls":11,"redis_feature_flag_duration_s":0.018717,"redis_feature_flag_read_bytes":1154,"redis_feature_flag_write_bytes":928,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006153,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.002298,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00228,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.061901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00404918,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.209481,"completed_at":"2026-09-18T22:15:04.359Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.045421,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1593gitlab # [ 309.814154] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:04.373Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"d17c659b976d1c433b1b9042","created_at":"2026-09-18T22:15:04.167Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"24a5447d066e200cb1a2ad2db57d99e4","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.174Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-d17c659b976d1c433b1b9042: start","job_status":"start","queue_duration_s":0.198566,"scheduling_latency_s":0.198622}1594gitlab # [ 310.843025] postgres[863]: [863] LOG: checkpoint starting: time1595gitlab # [ 311.131455] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:05.770Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"d17c659b976d1c433b1b9042","created_at":"2026-09-18T22:15:04.167Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"24a5447d066e200cb1a2ad2db57d99e4","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.174Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-d17c659b976d1c433b1b9042: done: 1.39709 sec","job_status":"done","queue_duration_s":0.198566,"scheduling_latency_s":0.198622,"redis_calls":563,"redis_duration_s":0.79504,"redis_read_bytes":688,"redis_write_bytes":48843,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000452,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":83,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001952,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.792636,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.67966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.39709,"completed_at":"2026-09-18T22:15:05.770Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1596gitlab # [ 311.211790] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:05.772Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"dd9ba824f81a8acd29360183","created_at":"2026-09-18T22:15:04.228Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b2fed272415006134bf478ce08d28b04","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.236Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-dd9ba824f81a8acd29360183: start","job_status":"start","queue_duration_s":1.536311,"scheduling_latency_s":1.536342}1597gitlab # [ 311.227428] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:05.812Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"dd9ba824f81a8acd29360183","created_at":"2026-09-18T22:15:04.228Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b2fed272415006134bf478ce08d28b04","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.236Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-dd9ba824f81a8acd29360183: done: 0.039583 sec","job_status":"done","queue_duration_s":1.536311,"scheduling_latency_s":1.536342,"redis_calls":17,"redis_duration_s":0.004743,"redis_read_bytes":400,"redis_write_bytes":4278,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000808,"redis_feature_flag_read_bytes":384,"redis_feature_flag_write_bytes":248,"redis_queues_calls":2,"redis_queues_duration_s":0.000518,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002506,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028571,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039583,"completed_at":"2026-09-18T22:15:05.811Z","load_balancing_strategy":"primary","db_duration_s":0.002972,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1598gitlab # [ 311.271146] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:05.813Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"58c84d05046611ab7b952a29","created_at":"2026-09-18T22:15:04.246Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a233db1ea0a9984ede88ba0d55aac43f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.254Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-58c84d05046611ab7b952a29: start","job_status":"start","queue_duration_s":1.55899,"scheduling_latency_s":1.559015}1599gitlab # [ 311.285673] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:05.825Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1600gitlab # [ 311.289443] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:05.832Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"58c84d05046611ab7b952a29","created_at":"2026-09-18T22:15:04.246Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a233db1ea0a9984ede88ba0d55aac43f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.254Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-58c84d05046611ab7b952a29: done: 0.018364 sec","job_status":"done","queue_duration_s":1.55899,"scheduling_latency_s":1.559015,"redis_calls":8,"redis_duration_s":0.0031290000000000003,"redis_read_bytes":133,"redis_write_bytes":931,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000298,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002305,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000526,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011379,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018364,"completed_at":"2026-09-18T22:15:05.832Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1601gitlab # [ 311.332444] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:05.833Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"e406f13d6af28532434f2fc6","created_at":"2026-09-18T22:15:04.281Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a5bb972bce6dae9aea33d33f8da729b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.303Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-e406f13d6af28532434f2fc6: start","job_status":"start","queue_duration_s":1.530481,"scheduling_latency_s":1.530502}1602gitlab # [ 311.346497] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:05.918Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"e406f13d6af28532434f2fc6","created_at":"2026-09-18T22:15:04.281Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a5bb972bce6dae9aea33d33f8da729b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.303Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-e406f13d6af28532434f2fc6: done: 0.084341 sec","job_status":"done","queue_duration_s":1.530481,"scheduling_latency_s":1.530502,"redis_calls":10,"redis_duration_s":0.006508,"redis_read_bytes":135,"redis_write_bytes":1275,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000356,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":106,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00406,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002092,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.038,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03508,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00095084,"exclusive_lock_hold_duration_s":0.03211226,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.084341,"completed_at":"2026-09-18T22:15:05.918Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.040249,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1603gitlab # [ 311.390419] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:05.920Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"3991eafe9ad0bd6de9d482cc","created_at":"2026-09-18T22:15:04.328Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e935aaaa97426e70791dfebe1f7b464","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.349Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-3991eafe9ad0bd6de9d482cc: start","job_status":"start","queue_duration_s":1.571073,"scheduling_latency_s":1.571104}1604gitlab # [ 311.404788] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:05.946Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"3991eafe9ad0bd6de9d482cc","created_at":"2026-09-18T22:15:04.328Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e935aaaa97426e70791dfebe1f7b464","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.349Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-3991eafe9ad0bd6de9d482cc: done: 0.025888 sec","job_status":"done","queue_duration_s":1.571073,"scheduling_latency_s":1.571104,"redis_calls":10,"redis_duration_s":0.0021390000000000003,"redis_read_bytes":389,"redis_write_bytes":1078,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000645,"redis_feature_flag_read_bytes":384,"redis_feature_flag_write_bytes":247,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001043,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000451,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025888,"completed_at":"2026-09-18T22:15:05.946Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1605gitlab # [ 311.446739] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:05.947Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"a39150388b2fe936e2190610","created_at":"2026-09-18T22:15:04.375Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec0a950f3a9321542b15c9895df4b480","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.392Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-a39150388b2fe936e2190610: start","job_status":"start","queue_duration_s":1.555543,"scheduling_latency_s":1.555568}1606gitlab # [ 311.459932] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:05.990Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"a39150388b2fe936e2190610","created_at":"2026-09-18T22:15:04.375Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec0a950f3a9321542b15c9895df4b480","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.392Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-a39150388b2fe936e2190610: done: 0.042321 sec","job_status":"done","queue_duration_s":1.555543,"scheduling_latency_s":1.555568,"redis_calls":10,"redis_duration_s":0.001713,"redis_read_bytes":9,"redis_write_bytes":1097,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000314,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":309,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001022,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000377,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":218,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024192,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031258,"duration_s":0.042321,"completed_at":"2026-09-18T22:15:05.990Z","load_balancing_strategy":"primary","db_duration_s":0.010837,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1607gitlab # [ 311.500505] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:05.991Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"54ccfbd01f17e177ef3a1baf","created_at":"2026-09-18T22:15:04.593Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"642a2593fa3799cfef6f62508cf75fbe","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.612Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-54ccfbd01f17e177ef3a1baf: start","job_status":"start","queue_duration_s":1.379024,"scheduling_latency_s":1.379051}1608gitlab # [ 311.514576] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.014Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"54ccfbd01f17e177ef3a1baf","created_at":"2026-09-18T22:15:04.593Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"642a2593fa3799cfef6f62508cf75fbe","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.612Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-54ccfbd01f17e177ef3a1baf: done: 0.023171 sec","job_status":"done","queue_duration_s":1.379024,"scheduling_latency_s":1.379051,"redis_calls":10,"redis_duration_s":0.001889,"redis_read_bytes":135,"redis_write_bytes":1184,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000185,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":97,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000804,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013983,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00056268,"exclusive_lock_hold_duration_s":0.00458692,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.023171,"completed_at":"2026-09-18T22:15:06.014Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002156,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1609gitlab # [ 311.558227] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.017Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"938a660bbdca61a15265fa15","created_at":"2026-09-18T22:15:04.650Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.664Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-938a660bbdca61a15265fa15: start","job_status":"start","queue_duration_s":1.353335,"scheduling_latency_s":1.353363}1610gitlab # [ 311.571728] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.127Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"938a660bbdca61a15265fa15","created_at":"2026-09-18T22:15:04.650Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.664Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-938a660bbdca61a15265fa15: done: 0.109991 sec","job_status":"done","queue_duration_s":1.353335,"scheduling_latency_s":1.353363,"redis_calls":65,"redis_duration_s":0.009914,"redis_read_bytes":748,"redis_write_bytes":41502,"redis_feature_flag_calls":5,"redis_feature_flag_duration_s":0.000625,"redis_feature_flag_read_bytes":640,"redis_feature_flag_write_bytes":393,"redis_queues_calls":2,"redis_queues_duration_s":0.00074,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.008121,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000428,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.100569,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.109991,"completed_at":"2026-09-18T22:15:06.127Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1611gitlab # [ 311.615535] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.129Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"f51110131d9231c909791749","created_at":"2026-09-18T22:15:04.694Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cfca802e371c51ac53a20de431414506","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-18T22:15:04.708Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-f51110131d9231c909791749: start","job_status":"start","queue_duration_s":1.421002,"scheduling_latency_s":1.421029}1612gitlab # [ 311.628931] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.137Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1613gitlab # [ 311.632524] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.143Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"f51110131d9231c909791749","created_at":"2026-09-18T22:15:04.694Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cfca802e371c51ac53a20de431414506","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-18T22:15:04.708Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-f51110131d9231c909791749: done: 0.014491 sec","job_status":"done","queue_duration_s":1.421002,"scheduling_latency_s":1.421029,"redis_calls":8,"redis_duration_s":0.001243,"redis_read_bytes":133,"redis_write_bytes":908,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000131,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":107,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000797,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000315,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014491,"completed_at":"2026-09-18T22:15:06.143Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1614gitlab # [ 311.672976] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.145Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"ae11900f76a72caf229683ea","created_at":"2026-09-18T22:15:04.737Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1b0364fc1695f35ff86ed7ce5dc4cdb","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.749Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-ae11900f76a72caf229683ea: start","job_status":"start","queue_duration_s":1.395374,"scheduling_latency_s":1.395392}1615gitlab # [ 311.686781] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.171Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"ae11900f76a72caf229683ea","created_at":"2026-09-18T22:15:04.737Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1b0364fc1695f35ff86ed7ce5dc4cdb","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.749Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-ae11900f76a72caf229683ea: done: 0.025857 sec","job_status":"done","queue_duration_s":1.395374,"scheduling_latency_s":1.395392,"redis_calls":8,"redis_duration_s":0.001333,"redis_read_bytes":133,"redis_write_bytes":800,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000135,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":89,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000853,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000345,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014795,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025857,"completed_at":"2026-09-18T22:15:06.171Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006495,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1616gitlab # [ 311.727845] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.172Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::Import::StuckProjectImportJobsWorker","jid":"0e9de3e46af971b46b58f0b8","created_at":"2026-09-18T22:15:04.782Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"249607c66e8f1072d3b6e6ca9859e276","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:65d1a1bda9b2a0115065de4f20868193e50a174305a7166fa20fbc82759e43e4","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.807Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::Import::StuckProjectImportJobsWorker JID-0e9de3e46af971b46b58f0b8: start","job_status":"start","queue_duration_s":1.364973,"scheduling_latency_s":1.364993}1617gitlab # [ 311.742505] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.204Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::Import::StuckProjectImportJobsWorker","jid":"0e9de3e46af971b46b58f0b8","created_at":"2026-09-18T22:15:04.782Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"249607c66e8f1072d3b6e6ca9859e276","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:65d1a1bda9b2a0115065de4f20868193e50a174305a7166fa20fbc82759e43e4","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.807Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::Import::StuckProjectImportJobsWorker JID-0e9de3e46af971b46b58f0b8: done: 0.032333 sec","job_status":"done","queue_duration_s":1.364973,"scheduling_latency_s":1.364993,"redis_calls":10,"redis_duration_s":0.001549,"redis_read_bytes":9,"redis_write_bytes":1173,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000313,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000919,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000317,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":236,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019131,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027334,"duration_s":0.032333,"completed_at":"2026-09-18T22:15:06.204Z","load_balancing_strategy":"primary","db_duration_s":0.006409,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1618gitlab # [ 311.783198] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.206Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"14033e27d7a4fb64f36c47c4","created_at":"2026-09-18T22:15:04.832Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2b9a58e8328ba90ac488f3e9c1047682","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.855Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-14033e27d7a4fb64f36c47c4: start","job_status":"start","queue_duration_s":1.350395,"scheduling_latency_s":1.350415}1619gitlab # [ 311.797541] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.227Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"14033e27d7a4fb64f36c47c4","created_at":"2026-09-18T22:15:04.832Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2b9a58e8328ba90ac488f3e9c1047682","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.855Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-14033e27d7a4fb64f36c47c4: done: 0.021383 sec","job_status":"done","queue_duration_s":1.350395,"scheduling_latency_s":1.350415,"redis_calls":11,"redis_duration_s":0.0018780000000000001,"redis_read_bytes":9,"redis_write_bytes":1239,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000353,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001087,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000438,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":298,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012032,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027096,"duration_s":0.021383,"completed_at":"2026-09-18T22:15:06.227Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000939,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1620gitlab # [ 311.839082] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.228Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMigrateExternalDiffsWorker","jid":"079263cfc39356f603052d0e","created_at":"2026-09-18T22:15:04.887Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"85066025affd8ee972157b602da7009e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1f56d9ee4ddd7fd390ae51dd41358b9c806acf2491cad4e28b1956ebf69a9b52","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.909Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMigrateExternalDiffsWorker JID-079263cfc39356f603052d0e: start","job_status":"start","queue_duration_s":1.319889,"scheduling_latency_s":1.319905}1621gitlab # [ 311.852486] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.247Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMigrateExternalDiffsWorker","jid":"079263cfc39356f603052d0e","created_at":"2026-09-18T22:15:04.887Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"85066025affd8ee972157b602da7009e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1f56d9ee4ddd7fd390ae51dd41358b9c806acf2491cad4e28b1956ebf69a9b52","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.909Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMigrateExternalDiffsWorker JID-079263cfc39356f603052d0e: done: 0.019073 sec","job_status":"done","queue_duration_s":1.319889,"scheduling_latency_s":1.319905,"redis_calls":12,"redis_duration_s":0.001634,"redis_read_bytes":11,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000273,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":311,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000757,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000604,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":533,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011362,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0005004,"exclusive_lock_hold_duration_s":0.00043692,"duration_s":0.019073,"completed_at":"2026-09-18T22:15:06.247Z","load_balancing_strategy":"primary","db_duration_s":0.000585,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1622gitlab # [ 311.893854] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.249Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"401c114de01f2edec5c43f70","created_at":"2026-09-18T22:15:04.931Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b11fcabf9614d5d15d9cff3ad6436247","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.952Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-401c114de01f2edec5c43f70: start","job_status":"start","queue_duration_s":1.297104,"scheduling_latency_s":1.297121}1623gitlab # [ 311.906718] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.277Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"401c114de01f2edec5c43f70","created_at":"2026-09-18T22:15:04.931Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b11fcabf9614d5d15d9cff3ad6436247","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.952Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-401c114de01f2edec5c43f70: done: 0.028435 sec","job_status":"done","queue_duration_s":1.297104,"scheduling_latency_s":1.297121,"redis_calls":11,"redis_duration_s":0.001549,"redis_read_bytes":10,"redis_write_bytes":1022,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000282,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":283,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0008,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000467,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":225,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016089,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025428,"duration_s":0.028435,"completed_at":"2026-09-18T22:15:06.277Z","load_balancing_strategy":"primary","db_duration_s":0.005801,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1624gitlab # [ 311.948558] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.278Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"49d49c2c361315558cbd95b9","created_at":"2026-09-18T22:15:04.973Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"45a96bc030001863396d52af34a16e2e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.986Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-49d49c2c361315558cbd95b9: start","job_status":"start","queue_duration_s":1.29285,"scheduling_latency_s":1.292866}1625gitlab # [ 311.963429] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.287Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1626gitlab # [ 311.967033] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.293Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"49d49c2c361315558cbd95b9","created_at":"2026-09-18T22:15:04.973Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"45a96bc030001863396d52af34a16e2e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:04.986Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-49d49c2c361315558cbd95b9: done: 0.014552 sec","job_status":"done","queue_duration_s":1.29285,"scheduling_latency_s":1.292866,"redis_calls":8,"redis_duration_s":0.001177,"redis_read_bytes":133,"redis_write_bytes":937,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000129,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":111,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000757,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000291,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009814,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014552,"completed_at":"2026-09-18T22:15:06.293Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1627gitlab # [ 312.009034] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.294Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"031d7bedcd256f70d07ff2c9","created_at":"2026-09-18T22:15:05.020Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b569a7180c9a24bb0ced4281e7b64108","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:05.033Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-031d7bedcd256f70d07ff2c9: start","job_status":"start","queue_duration_s":1.261666,"scheduling_latency_s":1.261682}1628gitlab # [ 312.022962] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.603Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"031d7bedcd256f70d07ff2c9","created_at":"2026-09-18T22:15:05.020Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b569a7180c9a24bb0ced4281e7b64108","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:05.033Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-031d7bedcd256f70d07ff2c9: done: 0.309208 sec","job_status":"done","queue_duration_s":1.261666,"scheduling_latency_s":1.261682,"redis_calls":11,"redis_duration_s":0.001838,"redis_read_bytes":263,"redis_write_bytes":1138,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000247,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":151,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000781,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00081,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.071,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.071,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.2065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00048436,"exclusive_lock_hold_duration_s":0.2920137,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.309208,"completed_at":"2026-09-18T22:15:06.603Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.121104,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1629gitlab # [ 312.067139] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.605Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c0945f1d8f5aa3bac453e676","created_at":"2026-09-18T22:15:05.051Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"024305f8f1187cc9ab2b6b6e8c2629b1","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:05.064Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c0945f1d8f5aa3bac453e676: start","job_status":"start","queue_duration_s":1.541082,"scheduling_latency_s":1.541102}1630gitlab # [ 312.080980] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.635Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c0945f1d8f5aa3bac453e676","created_at":"2026-09-18T22:15:05.051Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"024305f8f1187cc9ab2b6b6e8c2629b1","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:05.064Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c0945f1d8f5aa3bac453e676: done: 0.030302 sec","job_status":"done","queue_duration_s":1.541082,"scheduling_latency_s":1.541102,"redis_calls":8,"redis_duration_s":0.001931,"redis_read_bytes":133,"redis_write_bytes":936,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000133,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001468,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00033,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012095,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.030302,"completed_at":"2026-09-18T22:15:06.635Z","load_balancing_strategy":"primary","db_duration_s":0.012334,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1631gitlab # [ 312.122414] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.637Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"5be0fdbc67eb9e9534a925ec","created_at":"2026-09-18T22:15:05.087Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2c948863cb104a4780eca2e08ef5adb1","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:05.107Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-5be0fdbc67eb9e9534a925ec: start","job_status":"start","queue_duration_s":1.530041,"scheduling_latency_s":1.530062}1632gitlab # [ 312.137209] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.661Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"5be0fdbc67eb9e9534a925ec","created_at":"2026-09-18T22:15:05.087Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2c948863cb104a4780eca2e08ef5adb1","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:05.107Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-5be0fdbc67eb9e9534a925ec: done: 0.024538 sec","job_status":"done","queue_duration_s":1.530041,"scheduling_latency_s":1.530062,"redis_calls":11,"redis_duration_s":0.0017109999999999998,"redis_read_bytes":136,"redis_write_bytes":1339,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000129,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":100,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000887,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000695,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015278,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00668278,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.024538,"completed_at":"2026-09-18T22:15:06.661Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003902,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1633gitlab # [ 312.181914] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.663Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"0feaf921786b71226e21a84f","created_at":"2026-09-18T22:15:05.154Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"998e04a1ffec1594ed23f073311385e8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-18T22:15:05.165Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-0feaf921786b71226e21a84f: start","job_status":"start","queue_duration_s":1.497406,"scheduling_latency_s":1.497424}1634gitlab # [ 312.195141] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.672Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1635gitlab # [ 312.198509] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.678Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"0feaf921786b71226e21a84f","created_at":"2026-09-18T22:15:05.154Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"998e04a1ffec1594ed23f073311385e8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-18T22:15:05.165Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-0feaf921786b71226e21a84f: done: 0.014998 sec","job_status":"done","queue_duration_s":1.497406,"scheduling_latency_s":1.497424,"redis_calls":8,"redis_duration_s":0.00123,"redis_read_bytes":133,"redis_write_bytes":914,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000139,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":108,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000786,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000305,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009847,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014998,"completed_at":"2026-09-18T22:15:06.678Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1636gitlab # [ 312.238767] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.679Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"fe4b104240883839b73160fe","created_at":"2026-09-18T22:15:05.189Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4906ba427e9f16f73f10dd5103f8bfd1","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:05.210Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-fe4b104240883839b73160fe: start","job_status":"start","queue_duration_s":1.46866,"scheduling_latency_s":1.468677}1637gitlab # [ 312.252064] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.710Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"fe4b104240883839b73160fe","created_at":"2026-09-18T22:15:05.189Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4906ba427e9f16f73f10dd5103f8bfd1","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:05.210Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-fe4b104240883839b73160fe: done: 0.03134 sec","job_status":"done","queue_duration_s":1.46866,"scheduling_latency_s":1.468677,"redis_calls":10,"redis_duration_s":0.0014,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000301,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000815,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000284,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017724,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025908,"duration_s":0.03134,"completed_at":"2026-09-18T22:15:06.710Z","load_balancing_strategy":"primary","db_duration_s":0.007023,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1638gitlab # [ 312.292109] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.712Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"43650c6fa252eeedabb7b39d","created_at":"2026-09-18T22:15:05.280Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b7f3810b65385d8ba58e8e922d4f768a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-18T22:15:05.294Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-43650c6fa252eeedabb7b39d: start","job_status":"start","queue_duration_s":1.417768,"scheduling_latency_s":1.417784}1639gitlab # [ 312.304859] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.737Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"43650c6fa252eeedabb7b39d","created_at":"2026-09-18T22:15:05.280Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b7f3810b65385d8ba58e8e922d4f768a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-18T22:15:05.294Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-43650c6fa252eeedabb7b39d: done: 0.02535 sec","job_status":"done","queue_duration_s":1.417768,"scheduling_latency_s":1.417784,"redis_calls":8,"redis_duration_s":0.001245,"redis_read_bytes":133,"redis_write_bytes":836,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000121,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":95,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000806,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000318,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015907,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02535,"completed_at":"2026-09-18T22:15:06.737Z","load_balancing_strategy":"primary","db_duration_s":0.004063,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1640gitlab # [ 312.346133] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.738Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"37e2ae2f0131ec6ce6636da5","created_at":"2026-09-18T22:15:05.331Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"981175fa8159e391c6b92e5893e86e0a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:05.348Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-37e2ae2f0131ec6ce6636da5: start","job_status":"start","queue_duration_s":1.389929,"scheduling_latency_s":1.389946}1641gitlab # [ 312.359485] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.756Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"37e2ae2f0131ec6ce6636da5","created_at":"2026-09-18T22:15:05.331Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"981175fa8159e391c6b92e5893e86e0a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:05.348Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-37e2ae2f0131ec6ce6636da5: done: 0.018239 sec","job_status":"done","queue_duration_s":1.389929,"scheduling_latency_s":1.389946,"redis_calls":10,"redis_duration_s":0.001502,"redis_read_bytes":135,"redis_write_bytes":1167,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000117,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":95,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000755,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00063,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011849,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0004945,"exclusive_lock_hold_duration_s":0.00397868,"duration_s":0.018239,"completed_at":"2026-09-18T22:15:06.756Z","load_balancing_strategy":"primary","db_duration_s":0.001637,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1642gitlab # [ 312.400698] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.758Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"cac9e58178c7625b0f60fd27","created_at":"2026-09-18T22:15:05.369Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4bf654f575d85749de854213d04a213c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:05.385Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-cac9e58178c7625b0f60fd27: start","job_status":"start","queue_duration_s":1.372962,"scheduling_latency_s":1.372978}1643gitlab # [ 312.414965] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.766Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1644gitlab # [ 312.418791] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.771Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"cac9e58178c7625b0f60fd27","created_at":"2026-09-18T22:15:05.369Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4bf654f575d85749de854213d04a213c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:05.385Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-cac9e58178c7625b0f60fd27: done: 0.013557 sec","job_status":"done","queue_duration_s":1.372962,"scheduling_latency_s":1.372978,"redis_calls":8,"redis_duration_s":0.001143,"redis_read_bytes":133,"redis_write_bytes":867,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000119,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":101,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000757,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008898,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013557,"completed_at":"2026-09-18T22:15:06.771Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1645gitlab # [ 312.462209] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.772Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"666f067e2a36617878e73dae","created_at":"2026-09-18T22:15:05.435Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5c00d7b080e90213e683dbc23dfe72e4","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:05.451Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-666f067e2a36617878e73dae: start","job_status":"start","queue_duration_s":1.3218,"scheduling_latency_s":1.321817}1646gitlab # [ 312.476750] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.789Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"666f067e2a36617878e73dae","created_at":"2026-09-18T22:15:05.435Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5c00d7b080e90213e683dbc23dfe72e4","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:05.451Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-666f067e2a36617878e73dae: done: 0.016707 sec","job_status":"done","queue_duration_s":1.3218,"scheduling_latency_s":1.321817,"redis_calls":8,"redis_duration_s":0.001143,"redis_read_bytes":133,"redis_write_bytes":764,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000119,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":83,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000744,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00028,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010633,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016707,"completed_at":"2026-09-18T22:15:06.789Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001515,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1647gitlab # [ 312.519555] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.790Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"792e7a8babaf2c941adf4eac","created_at":"2026-09-18T22:15:05.475Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d7bf196e2c768289da274361bb036ec6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:05.487Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-792e7a8babaf2c941adf4eac: start","job_status":"start","queue_duration_s":1.30368,"scheduling_latency_s":1.303698}1648gitlab # [ 312.534688] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.836Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"792e7a8babaf2c941adf4eac","created_at":"2026-09-18T22:15:05.475Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d7bf196e2c768289da274361bb036ec6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:05.487Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-792e7a8babaf2c941adf4eac: done: 0.045749 sec","job_status":"done","queue_duration_s":1.30368,"scheduling_latency_s":1.303698,"redis_calls":10,"redis_duration_s":0.001678,"redis_read_bytes":135,"redis_write_bytes":1267,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000145,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":105,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000772,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000761,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022106,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00050616,"exclusive_lock_hold_duration_s":0.0297836,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.045749,"completed_at":"2026-09-18T22:15:06.836Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019408,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1649gitlab # [ 312.581681] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.838Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"b069751b02f1b93d57a30a19","created_at":"2026-09-18T22:15:05.501Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7da3039a7fd123ef4c07dce5b0429e2a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:05.518Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-b069751b02f1b93d57a30a19: start","job_status":"start","queue_duration_s":1.319779,"scheduling_latency_s":1.319798}1650gitlab # [ 312.596497] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.846Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1651gitlab # [ 312.599696] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.852Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"b069751b02f1b93d57a30a19","created_at":"2026-09-18T22:15:05.501Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7da3039a7fd123ef4c07dce5b0429e2a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:05.518Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-b069751b02f1b93d57a30a19: done: 0.014382 sec","job_status":"done","queue_duration_s":1.319779,"scheduling_latency_s":1.319798,"redis_calls":8,"redis_duration_s":0.001132,"redis_read_bytes":133,"redis_write_bytes":873,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000122,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":102,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000703,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000307,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009351,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014382,"completed_at":"2026-09-18T22:15:06.852Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1652gitlab # [ 312.643030] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.853Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"91fb1c77abfaa274e81a445f","created_at":"2026-09-18T22:15:05.542Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bee1cdbcaaa705e50d71f6d838c928c7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:05.558Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-91fb1c77abfaa274e81a445f: start","job_status":"start","queue_duration_s":1.294946,"scheduling_latency_s":1.294963}1653gitlab # [ 312.658103] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.867Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"91fb1c77abfaa274e81a445f","created_at":"2026-09-18T22:15:05.542Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-2aaf5a674dec4f2e","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bee1cdbcaaa705e50d71f6d838c928c7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:05.558Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-91fb1c77abfaa274e81a445f: done: 0.014265 sec","job_status":"done","queue_duration_s":1.294946,"scheduling_latency_s":1.294963,"redis_calls":8,"redis_duration_s":0.00109,"redis_read_bytes":133,"redis_write_bytes":879,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000124,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":103,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000694,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000272,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014265,"completed_at":"2026-09-18T22:15:06.867Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1654gitlab # [ 312.700706] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.869Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"74e04ff4d27d51e0d17e059b","created_at":"2026-09-18T22:15:05.790Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-12c0072399a84624","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b2fed272415006134bf478ce08d28b04","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:05.803Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-74e04ff4d27d51e0d17e059b: start","job_status":"start","queue_duration_s":1.06593,"scheduling_latency_s":1.065946}1655gitlab # [ 312.713238] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.882Z","message":"No existing merge request to be cleaned up."}1656gitlab # [ 312.714934] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.891Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"74e04ff4d27d51e0d17e059b","created_at":"2026-09-18T22:15:05.790Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-12c0072399a84624","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b2fed272415006134bf478ce08d28b04","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:05.803Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-74e04ff4d27d51e0d17e059b: done: 0.022362 sec","job_status":"done","queue_duration_s":1.06593,"scheduling_latency_s":1.065946,"redis_calls":11,"redis_duration_s":0.001739,"redis_read_bytes":136,"redis_write_bytes":1104,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000158,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":82,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000669,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022362,"completed_at":"2026-09-18T22:15:06.891Z","load_balancing_strategy":"primary","db_duration_s":0.003085,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1657gitlab # [ 312.757383] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.892Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"641b777fbbf8fca87e42910e","created_at":"2026-09-18T22:15:05.790Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-12c0072399a84624","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b2fed272415006134bf478ce08d28b04","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:05.803Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-641b777fbbf8fca87e42910e: start","job_status":"start","queue_duration_s":1.089523,"scheduling_latency_s":1.08954}1658gitlab # [ 312.770673] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.904Z","message":"No existing merge request to be cleaned up."}1659gitlab # [ 312.772473] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.912Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"641b777fbbf8fca87e42910e","created_at":"2026-09-18T22:15:05.790Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-12c0072399a84624","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b2fed272415006134bf478ce08d28b04","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:05.803Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-641b777fbbf8fca87e42910e: done: 0.019879 sec","job_status":"done","queue_duration_s":1.089523,"scheduling_latency_s":1.08954,"redis_calls":10,"redis_duration_s":0.001425,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000607,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000818,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013624,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019879,"completed_at":"2026-09-18T22:15:06.912Z","load_balancing_strategy":"primary","db_duration_s":0.002431,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1660gitlab # [ 312.812700] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.913Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cb3a924b22868fcf2277256c","created_at":"2026-09-18T22:15:05.790Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-12c0072399a84624","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b2fed272415006134bf478ce08d28b04","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:05.803Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cb3a924b22868fcf2277256c: start","job_status":"start","queue_duration_s":1.110613,"scheduling_latency_s":1.110631}1661gitlab # [ 312.825240] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.925Z","message":"No existing merge request to be cleaned up."}1662gitlab # [ 312.827352] gitaly[920]: time="2026-09-18T22:15:07.410Z" level=info msg="burden monitor stats" pid=9201663gitlab # [ 312.828679] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.933Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cb3a924b22868fcf2277256c","created_at":"2026-09-18T22:15:05.790Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-12c0072399a84624","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b2fed272415006134bf478ce08d28b04","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:05.803Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cb3a924b22868fcf2277256c: done: 0.019895 sec","job_status":"done","queue_duration_s":1.110613,"scheduling_latency_s":1.110631,"redis_calls":10,"redis_duration_s":0.0013930000000000001,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000814,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019895,"completed_at":"2026-09-18T22:15:06.933Z","load_balancing_strategy":"primary","db_duration_s":0.002694,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1664gitlab # [ 312.868216] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.934Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7974d66b4620bc8817dacc4d","created_at":"2026-09-18T22:15:05.790Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-12c0072399a84624","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b2fed272415006134bf478ce08d28b04","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:05.803Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7974d66b4620bc8817dacc4d: start","job_status":"start","queue_duration_s":1.131675,"scheduling_latency_s":1.131692}1665gitlab # [ 312.880681] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.945Z","message":"No existing merge request to be cleaned up."}1666gitlab # [ 312.882384] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.953Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7974d66b4620bc8817dacc4d","created_at":"2026-09-18T22:15:05.790Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-12c0072399a84624","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b2fed272415006134bf478ce08d28b04","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:05.803Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7974d66b4620bc8817dacc4d: done: 0.018733 sec","job_status":"done","queue_duration_s":1.131675,"scheduling_latency_s":1.131692,"redis_calls":10,"redis_duration_s":0.0014,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000581,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000819,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012845,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018733,"completed_at":"2026-09-18T22:15:06.953Z","load_balancing_strategy":"primary","db_duration_s":0.002119,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1667gitlab # [ 312.921569] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.954Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a9b2c212fd23960526a4ed1","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a9b2c212fd23960526a4ed1: start","job_status":"start","queue_duration_s":0.835622,"scheduling_latency_s":0.835639}1668gitlab # [ 312.934294] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.970Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a9b2c212fd23960526a4ed1","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a9b2c212fd23960526a4ed1: done: 0.015846 sec","job_status":"done","queue_duration_s":0.835622,"scheduling_latency_s":0.835639,"redis_calls":14,"redis_duration_s":0.001716,"redis_read_bytes":138,"redis_write_bytes":1242,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000125,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":85,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000576,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001015,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015846,"completed_at":"2026-09-18T22:15:06.970Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1669gitlab # [ 312.977856] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.971Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3c3bb7b19f56d55cb4e3706","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3c3bb7b19f56d55cb4e3706: start","job_status":"start","queue_duration_s":0.852694,"scheduling_latency_s":0.85271}1670gitlab # [ 312.990861] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.987Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3c3bb7b19f56d55cb4e3706","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3c3bb7b19f56d55cb4e3706: done: 0.01514 sec","job_status":"done","queue_duration_s":0.852694,"scheduling_latency_s":0.85271,"redis_calls":13,"redis_duration_s":0.0016389999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000581,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01514,"completed_at":"2026-09-18T22:15:06.986Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1671gitlab # [ 313.030921] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:06.988Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2cf60835e533b0f99787e889","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2cf60835e533b0f99787e889: start","job_status":"start","queue_duration_s":0.869033,"scheduling_latency_s":0.869051}1672gitlab # [ 313.044190] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.003Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2cf60835e533b0f99787e889","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2cf60835e533b0f99787e889: done: 0.014809 sec","job_status":"done","queue_duration_s":0.869033,"scheduling_latency_s":0.869051,"redis_calls":13,"redis_duration_s":0.001555,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000573,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010087,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014809,"completed_at":"2026-09-18T22:15:07.002Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1673gitlab # [ 313.084068] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.004Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3840f4f1c0189ed12dedfd9","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3840f4f1c0189ed12dedfd9: start","job_status":"start","queue_duration_s":0.884983,"scheduling_latency_s":0.884999}1674gitlab # [ 313.096415] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.018Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3840f4f1c0189ed12dedfd9","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3840f4f1c0189ed12dedfd9: done: 0.014624 sec","job_status":"done","queue_duration_s":0.884983,"scheduling_latency_s":0.884999,"redis_calls":13,"redis_duration_s":0.001536,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000991,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014624,"completed_at":"2026-09-18T22:15:07.018Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1675gitlab # [ 313.135609] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.020Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"143fc0ca6d9a878296c1d252","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-143fc0ca6d9a878296c1d252: start","job_status":"start","queue_duration_s":0.900792,"scheduling_latency_s":0.900807}1676gitlab # [ 313.148643] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.035Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"143fc0ca6d9a878296c1d252","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-143fc0ca6d9a878296c1d252: done: 0.015018 sec","job_status":"done","queue_duration_s":0.900792,"scheduling_latency_s":0.900807,"redis_calls":13,"redis_duration_s":0.00182,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001255,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010216,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015018,"completed_at":"2026-09-18T22:15:07.034Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1677gitlab # [ 313.188598] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.036Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c92a3420508e1daf2c8ec4b","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c92a3420508e1daf2c8ec4b: start","job_status":"start","queue_duration_s":0.916939,"scheduling_latency_s":0.916954}1678gitlab # [ 313.200572] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.050Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c92a3420508e1daf2c8ec4b","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c92a3420508e1daf2c8ec4b: done: 0.014638 sec","job_status":"done","queue_duration_s":0.916939,"scheduling_latency_s":0.916954,"redis_calls":13,"redis_duration_s":0.0015119999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000958,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010095,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014638,"completed_at":"2026-09-18T22:15:07.050Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1679gitlab # [ 313.239100] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05d4fd356e7d5b34c3b5610f","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05d4fd356e7d5b34c3b5610f: start","job_status":"start","queue_duration_s":0.93278,"scheduling_latency_s":0.932798}1680gitlab # [ 313.251348] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.066Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05d4fd356e7d5b34c3b5610f","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05d4fd356e7d5b34c3b5610f: done: 0.014957 sec","job_status":"done","queue_duration_s":0.93278,"scheduling_latency_s":0.932798,"redis_calls":13,"redis_duration_s":0.001548,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014957,"completed_at":"2026-09-18T22:15:07.066Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1681gitlab # [ 313.289776] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b430ac9bc1a9fba3da1bc80","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b430ac9bc1a9fba3da1bc80: start","job_status":"start","queue_duration_s":0.949178,"scheduling_latency_s":0.949195}1682gitlab # [ 313.301862] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.083Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b430ac9bc1a9fba3da1bc80","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b430ac9bc1a9fba3da1bc80: done: 0.015548 sec","job_status":"done","queue_duration_s":0.949178,"scheduling_latency_s":0.949195,"redis_calls":13,"redis_duration_s":0.001602,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000619,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000983,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010871,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015548,"completed_at":"2026-09-18T22:15:07.083Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1683gitlab # [ 313.340268] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.085Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbdb0c0a38e2ae8353d9bd96","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbdb0c0a38e2ae8353d9bd96: start","job_status":"start","queue_duration_s":0.966043,"scheduling_latency_s":0.966062}1684gitlab # [ 313.352396] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.100Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbdb0c0a38e2ae8353d9bd96","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbdb0c0a38e2ae8353d9bd96: done: 0.015231 sec","job_status":"done","queue_duration_s":0.966043,"scheduling_latency_s":0.966062,"redis_calls":13,"redis_duration_s":0.001671,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001112,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010514,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015231,"completed_at":"2026-09-18T22:15:07.100Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1685gitlab # [ 313.391738] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.101Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f5ef4a0bc8b90b9d2ef7c76","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f5ef4a0bc8b90b9d2ef7c76: start","job_status":"start","queue_duration_s":0.982415,"scheduling_latency_s":0.982431}1686gitlab # [ 313.404162] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.117Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f5ef4a0bc8b90b9d2ef7c76","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f5ef4a0bc8b90b9d2ef7c76: done: 0.015823 sec","job_status":"done","queue_duration_s":0.982415,"scheduling_latency_s":0.982431,"redis_calls":13,"redis_duration_s":0.0015480000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011234,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015823,"completed_at":"2026-09-18T22:15:07.117Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1687gitlab # [ 313.442415] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.118Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b21445e4ac79caf9c939c17","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b21445e4ac79caf9c939c17: start","job_status":"start","queue_duration_s":0.999445,"scheduling_latency_s":0.999461}1688gitlab # [ 313.454675] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.150Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b21445e4ac79caf9c939c17","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b21445e4ac79caf9c939c17: done: 0.031871 sec","job_status":"done","queue_duration_s":0.999445,"scheduling_latency_s":0.999461,"redis_calls":13,"redis_duration_s":0.001668,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026704,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031871,"completed_at":"2026-09-18T22:15:07.150Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1689gitlab # [ 313.492735] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.151Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c0e1487415346a6412c8a05","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c0e1487415346a6412c8a05: start","job_status":"start","queue_duration_s":1.032561,"scheduling_latency_s":1.032579}1690gitlab # [ 313.504819] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.167Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c0e1487415346a6412c8a05","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c0e1487415346a6412c8a05: done: 0.015243 sec","job_status":"done","queue_duration_s":1.032561,"scheduling_latency_s":1.032579,"redis_calls":13,"redis_duration_s":0.001631,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000593,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001038,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010428,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015243,"completed_at":"2026-09-18T22:15:07.166Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1691gitlab # [ 313.543193] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.168Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e33dbdbacc0d8f625250808e","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e33dbdbacc0d8f625250808e: start","job_status":"start","queue_duration_s":1.049033,"scheduling_latency_s":1.04905}1692gitlab # [ 313.555227] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.182Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e33dbdbacc0d8f625250808e","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e33dbdbacc0d8f625250808e: done: 0.014702 sec","job_status":"done","queue_duration_s":1.049033,"scheduling_latency_s":1.04905,"redis_calls":13,"redis_duration_s":0.0015760000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010056,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014702,"completed_at":"2026-09-18T22:15:07.182Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1693gitlab # [ 313.595146] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.184Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a3b612d7e8c2f9ca38cc83c","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a3b612d7e8c2f9ca38cc83c: start","job_status":"start","queue_duration_s":1.064871,"scheduling_latency_s":1.064888}1694gitlab # [ 313.607448] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.198Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a3b612d7e8c2f9ca38cc83c","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a3b612d7e8c2f9ca38cc83c: done: 0.014585 sec","job_status":"done","queue_duration_s":1.064871,"scheduling_latency_s":1.064888,"redis_calls":13,"redis_duration_s":0.001472,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000928,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014585,"completed_at":"2026-09-18T22:15:07.198Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1695gitlab # [ 313.646020] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.199Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21b98afb5702689fd20cc78f","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21b98afb5702689fd20cc78f: start","job_status":"start","queue_duration_s":1.080602,"scheduling_latency_s":1.080618}1696gitlab # [ 313.658374] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.214Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21b98afb5702689fd20cc78f","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21b98afb5702689fd20cc78f: done: 0.014446 sec","job_status":"done","queue_duration_s":1.080602,"scheduling_latency_s":1.080618,"redis_calls":13,"redis_duration_s":0.001448,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014446,"completed_at":"2026-09-18T22:15:07.214Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1697gitlab # [ 313.696755] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.215Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53658e1327e00ef38b3a01ce","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53658e1327e00ef38b3a01ce: start","job_status":"start","queue_duration_s":1.096164,"scheduling_latency_s":1.09618}1698gitlab # [ 313.708922] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.230Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53658e1327e00ef38b3a01ce","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53658e1327e00ef38b3a01ce: done: 0.014814 sec","job_status":"done","queue_duration_s":1.096164,"scheduling_latency_s":1.09618,"redis_calls":13,"redis_duration_s":0.0014659999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000932,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010023,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014814,"completed_at":"2026-09-18T22:15:07.230Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1699gitlab # [ 313.747274] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.231Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8774e16082ce616c1dc5f31","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8774e16082ce616c1dc5f31: start","job_status":"start","queue_duration_s":1.112137,"scheduling_latency_s":1.112152}1700gitlab # [ 313.759542] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.245Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8774e16082ce616c1dc5f31","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8774e16082ce616c1dc5f31: done: 0.014557 sec","job_status":"done","queue_duration_s":1.112137,"scheduling_latency_s":1.112152,"redis_calls":13,"redis_duration_s":0.001503,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010088,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014557,"completed_at":"2026-09-18T22:15:07.245Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1701gitlab # [ 313.799086] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.247Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58fda6428eabea66ffbc1484","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58fda6428eabea66ffbc1484: start","job_status":"start","queue_duration_s":1.127887,"scheduling_latency_s":1.127904}1702gitlab # [ 313.811356] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.261Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58fda6428eabea66ffbc1484","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58fda6428eabea66ffbc1484: done: 0.014563 sec","job_status":"done","queue_duration_s":1.127887,"scheduling_latency_s":1.127904,"redis_calls":13,"redis_duration_s":0.001496,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000947,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014563,"completed_at":"2026-09-18T22:15:07.261Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1703gitlab # [ 313.849882] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9d0e271faef96ffb0e6a83f","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9d0e271faef96ffb0e6a83f: start","job_status":"start","queue_duration_s":1.143565,"scheduling_latency_s":1.143581}1704gitlab # [ 313.862007] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.276Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9d0e271faef96ffb0e6a83f","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9d0e271faef96ffb0e6a83f: done: 0.014097 sec","job_status":"done","queue_duration_s":1.143565,"scheduling_latency_s":1.143581,"redis_calls":13,"redis_duration_s":0.001422,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000907,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009767,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014097,"completed_at":"2026-09-18T22:15:07.276Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1705gitlab # [ 313.899949] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.277Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3671fe233df7da5953954e2a","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3671fe233df7da5953954e2a: start","job_status":"start","queue_duration_s":1.158756,"scheduling_latency_s":1.158771}1706gitlab # [ 313.912256] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.292Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3671fe233df7da5953954e2a","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3671fe233df7da5953954e2a: done: 0.014331 sec","job_status":"done","queue_duration_s":1.158756,"scheduling_latency_s":1.158771,"redis_calls":13,"redis_duration_s":0.0014589999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000939,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014331,"completed_at":"2026-09-18T22:15:07.292Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1707gitlab # [ 313.950604] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.293Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2863954bc63f56385696d50f","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2863954bc63f56385696d50f: start","job_status":"start","queue_duration_s":1.174257,"scheduling_latency_s":1.174274}1708gitlab # [ 313.962769] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.307Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2863954bc63f56385696d50f","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2863954bc63f56385696d50f: done: 0.014278 sec","job_status":"done","queue_duration_s":1.174257,"scheduling_latency_s":1.174274,"redis_calls":13,"redis_duration_s":0.0014520000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009869,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014278,"completed_at":"2026-09-18T22:15:07.307Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1709gitlab # [ 314.002358] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.308Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f6ddd31f7d429b26036ba7b","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f6ddd31f7d429b26036ba7b: start","job_status":"start","queue_duration_s":1.189674,"scheduling_latency_s":1.18969}1710gitlab # [ 314.014551] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.327Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f6ddd31f7d429b26036ba7b","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f6ddd31f7d429b26036ba7b: done: 0.018281 sec","job_status":"done","queue_duration_s":1.189674,"scheduling_latency_s":1.18969,"redis_calls":13,"redis_duration_s":0.001532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000584,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000948,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018281,"completed_at":"2026-09-18T22:15:07.327Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1711gitlab # [ 314.052610] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.329Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a1de7b89f766f843e716664","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a1de7b89f766f843e716664: start","job_status":"start","queue_duration_s":1.210452,"scheduling_latency_s":1.210472}1712gitlab # [ 314.064747] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.357Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a1de7b89f766f843e716664","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a1de7b89f766f843e716664: done: 0.02794 sec","job_status":"done","queue_duration_s":1.210452,"scheduling_latency_s":1.210472,"redis_calls":13,"redis_duration_s":0.001589,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000572,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01079,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02794,"completed_at":"2026-09-18T22:15:07.357Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1713gitlab # [ 314.103323] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.358Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe97e0fa222303153267a8e5","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe97e0fa222303153267a8e5: start","job_status":"start","queue_duration_s":1.239648,"scheduling_latency_s":1.239664}1714gitlab # [ 314.115519] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.374Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe97e0fa222303153267a8e5","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe97e0fa222303153267a8e5: done: 0.015901 sec","job_status":"done","queue_duration_s":1.239648,"scheduling_latency_s":1.239664,"redis_calls":13,"redis_duration_s":0.001727,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000626,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011049,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015901,"completed_at":"2026-09-18T22:15:07.374Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1715gitlab # [ 314.154194] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ddd4dd19ba96ee62b17b339","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ddd4dd19ba96ee62b17b339: start","job_status":"start","queue_duration_s":1.256951,"scheduling_latency_s":1.256969}1716gitlab # [ 314.166407] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.393Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ddd4dd19ba96ee62b17b339","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ddd4dd19ba96ee62b17b339: done: 0.017031 sec","job_status":"done","queue_duration_s":1.256951,"scheduling_latency_s":1.256969,"redis_calls":13,"redis_duration_s":0.002127,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000767,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00136,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017031,"completed_at":"2026-09-18T22:15:07.393Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1717gitlab # [ 314.205915] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.394Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee07337245f67c5fad286e69","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee07337245f67c5fad286e69: start","job_status":"start","queue_duration_s":1.275562,"scheduling_latency_s":1.275581}1718gitlab # [ 314.217945] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.410Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee07337245f67c5fad286e69","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee07337245f67c5fad286e69: done: 0.015759 sec","job_status":"done","queue_duration_s":1.275562,"scheduling_latency_s":1.275581,"redis_calls":13,"redis_duration_s":0.001575,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001027,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015759,"completed_at":"2026-09-18T22:15:07.410Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1719gitlab # [ 314.256255] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.411Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4b1af44ec2c94abea76fbe5","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4b1af44ec2c94abea76fbe5: start","job_status":"start","queue_duration_s":1.292486,"scheduling_latency_s":1.292503}1720gitlab # [ 314.268328] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4b1af44ec2c94abea76fbe5","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4b1af44ec2c94abea76fbe5: done: 0.014424 sec","job_status":"done","queue_duration_s":1.292486,"scheduling_latency_s":1.292503,"redis_calls":13,"redis_duration_s":0.001457,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000927,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009898,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014424,"completed_at":"2026-09-18T22:15:07.426Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1721gitlab # [ 314.306171] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.427Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3616563a827ae4dfe82ada8","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3616563a827ae4dfe82ada8: start","job_status":"start","queue_duration_s":1.30815,"scheduling_latency_s":1.308167}1722gitlab # [ 314.318350] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.442Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3616563a827ae4dfe82ada8","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3616563a827ae4dfe82ada8: done: 0.015154 sec","job_status":"done","queue_duration_s":1.30815,"scheduling_latency_s":1.308167,"redis_calls":13,"redis_duration_s":0.001548,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000983,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015154,"completed_at":"2026-09-18T22:15:07.442Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1723gitlab # [ 314.356208] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.443Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f03771f06278925a2bd9dd97","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f03771f06278925a2bd9dd97: start","job_status":"start","queue_duration_s":1.324568,"scheduling_latency_s":1.324586}1724gitlab # [ 314.368282] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f03771f06278925a2bd9dd97","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f03771f06278925a2bd9dd97: done: 0.01491 sec","job_status":"done","queue_duration_s":1.324568,"scheduling_latency_s":1.324586,"redis_calls":13,"redis_duration_s":0.0016510000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000594,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001057,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01491,"completed_at":"2026-09-18T22:15:07.458Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1725gitlab # [ 314.407940] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.459Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d29a8d182423384ad900bbd6","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d29a8d182423384ad900bbd6: start","job_status":"start","queue_duration_s":1.340716,"scheduling_latency_s":1.340733}1726gitlab # [ 314.420317] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.474Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d29a8d182423384ad900bbd6","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d29a8d182423384ad900bbd6: done: 0.014539 sec","job_status":"done","queue_duration_s":1.340716,"scheduling_latency_s":1.340733,"redis_calls":13,"redis_duration_s":0.001563,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000578,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014539,"completed_at":"2026-09-18T22:15:07.474Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1727gitlab # [ 314.458345] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.475Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15cc640f90cbd7f2fda75115","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15cc640f90cbd7f2fda75115: start","job_status":"start","queue_duration_s":1.356464,"scheduling_latency_s":1.356481}1728gitlab # [ 314.470573] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.490Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15cc640f90cbd7f2fda75115","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15cc640f90cbd7f2fda75115: done: 0.014586 sec","job_status":"done","queue_duration_s":1.356464,"scheduling_latency_s":1.356481,"redis_calls":13,"redis_duration_s":0.001543,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000974,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014586,"completed_at":"2026-09-18T22:15:07.490Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1729gitlab # [ 314.508457] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.491Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92902e0caa4f8159e1cc85d5","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92902e0caa4f8159e1cc85d5: start","job_status":"start","queue_duration_s":1.372281,"scheduling_latency_s":1.372297}1730gitlab # [ 314.520551] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.505Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92902e0caa4f8159e1cc85d5","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92902e0caa4f8159e1cc85d5: done: 0.014339 sec","job_status":"done","queue_duration_s":1.372281,"scheduling_latency_s":1.372297,"redis_calls":13,"redis_duration_s":0.0014680000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000931,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009898,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014339,"completed_at":"2026-09-18T22:15:07.505Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1731gitlab # [ 314.558995] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.506Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50e97e55a5bee63a0a563e4c","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50e97e55a5bee63a0a563e4c: start","job_status":"start","queue_duration_s":1.387751,"scheduling_latency_s":1.387767}1732gitlab # [ 314.571090] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.521Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50e97e55a5bee63a0a563e4c","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50e97e55a5bee63a0a563e4c: done: 0.014242 sec","job_status":"done","queue_duration_s":1.387751,"scheduling_latency_s":1.387767,"redis_calls":13,"redis_duration_s":0.001458,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000928,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014242,"completed_at":"2026-09-18T22:15:07.521Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1733gitlab # [ 314.612525] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.522Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f92f42436caec443cc9f7288","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f92f42436caec443cc9f7288: start","job_status":"start","queue_duration_s":1.403148,"scheduling_latency_s":1.403164}1734gitlab # [ 314.624629] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.537Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f92f42436caec443cc9f7288","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f92f42436caec443cc9f7288: done: 0.014805 sec","job_status":"done","queue_duration_s":1.403148,"scheduling_latency_s":1.403164,"redis_calls":13,"redis_duration_s":0.0017499999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001189,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014805,"completed_at":"2026-09-18T22:15:07.537Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1735gitlab # [ 314.662928] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.538Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a21f5b13cb99a7086e6f1dbb","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a21f5b13cb99a7086e6f1dbb: start","job_status":"start","queue_duration_s":1.41909,"scheduling_latency_s":1.419106}1736gitlab # [ 314.675271] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.552Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a21f5b13cb99a7086e6f1dbb","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a21f5b13cb99a7086e6f1dbb: done: 0.014296 sec","job_status":"done","queue_duration_s":1.41909,"scheduling_latency_s":1.419106,"redis_calls":13,"redis_duration_s":0.0015170000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000557,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009891,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014296,"completed_at":"2026-09-18T22:15:07.552Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1737gitlab # [ 314.714178] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.553Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ebacca61d125c25e4b83c5a","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ebacca61d125c25e4b83c5a: start","job_status":"start","queue_duration_s":1.434554,"scheduling_latency_s":1.434571}1738gitlab # [ 314.726717] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.568Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ebacca61d125c25e4b83c5a","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ebacca61d125c25e4b83c5a: done: 0.014499 sec","job_status":"done","queue_duration_s":1.434554,"scheduling_latency_s":1.434571,"redis_calls":13,"redis_duration_s":0.0015580000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014499,"completed_at":"2026-09-18T22:15:07.568Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1739gitlab # [ 314.765782] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.569Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"847886c06da7c82350cebc86","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-847886c06da7c82350cebc86: start","job_status":"start","queue_duration_s":1.450239,"scheduling_latency_s":1.450254}1740gitlab # [ 314.778193] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"847886c06da7c82350cebc86","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-847886c06da7c82350cebc86: done: 0.014445 sec","job_status":"done","queue_duration_s":1.450239,"scheduling_latency_s":1.450254,"redis_calls":13,"redis_duration_s":0.001526,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000958,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014445,"completed_at":"2026-09-18T22:15:07.583Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1741gitlab # [ 314.818263] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.585Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43888be3f1ca8f8e796e6309","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43888be3f1ca8f8e796e6309: start","job_status":"start","queue_duration_s":1.465822,"scheduling_latency_s":1.465838}1742gitlab # [ 314.830384] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.599Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43888be3f1ca8f8e796e6309","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43888be3f1ca8f8e796e6309: done: 0.014255 sec","job_status":"done","queue_duration_s":1.465822,"scheduling_latency_s":1.465838,"redis_calls":13,"redis_duration_s":0.001459,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014255,"completed_at":"2026-09-18T22:15:07.599Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1743gitlab # [ 314.869845] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.600Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5c1d465e2978f527f4ab2ca","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5c1d465e2978f527f4ab2ca: start","job_status":"start","queue_duration_s":1.481253,"scheduling_latency_s":1.481269}1744gitlab # [ 314.906841] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.614Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5c1d465e2978f527f4ab2ca","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5c1d465e2978f527f4ab2ca: done: 0.01426 sec","job_status":"done","queue_duration_s":1.481253,"scheduling_latency_s":1.481269,"redis_calls":13,"redis_duration_s":0.001531,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009794,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01426,"completed_at":"2026-09-18T22:15:07.614Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1745gitlab # [ 315.012231] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.615Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6bb838894c0446f054bd3b22","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6bb838894c0446f054bd3b22: start","job_status":"start","queue_duration_s":1.49675,"scheduling_latency_s":1.496768}1746gitlab # [ 315.046493] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.631Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6bb838894c0446f054bd3b22","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6bb838894c0446f054bd3b22: done: 0.01514 sec","job_status":"done","queue_duration_s":1.49675,"scheduling_latency_s":1.496768,"redis_calls":13,"redis_duration_s":0.001605,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000573,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010487,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01514,"completed_at":"2026-09-18T22:15:07.631Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1747gitlab # [ 315.107225] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.632Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"900fc97c106e991d622e4399","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-900fc97c106e991d622e4399: start","job_status":"start","queue_duration_s":1.513381,"scheduling_latency_s":1.513399}1748gitlab # [ 315.123867] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.648Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"900fc97c106e991d622e4399","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-900fc97c106e991d622e4399: done: 0.015568 sec","job_status":"done","queue_duration_s":1.513381,"scheduling_latency_s":1.513399,"redis_calls":13,"redis_duration_s":0.001667,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000619,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001048,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010693,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015568,"completed_at":"2026-09-18T22:15:07.648Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1749gitlab # [ 315.171087] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.649Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5b55d6a8ca873a15f82f412","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5b55d6a8ca873a15f82f412: start","job_status":"start","queue_duration_s":1.530151,"scheduling_latency_s":1.530169}1750gitlab # [ 315.184089] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.664Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5b55d6a8ca873a15f82f412","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5b55d6a8ca873a15f82f412: done: 0.01537 sec","job_status":"done","queue_duration_s":1.530151,"scheduling_latency_s":1.530169,"redis_calls":13,"redis_duration_s":0.001694,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000657,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001037,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010728,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01537,"completed_at":"2026-09-18T22:15:07.664Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1751gitlab # [ 315.223669] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.665Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c9d11fe5ee748085b605ebd","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c9d11fe5ee748085b605ebd: start","job_status":"start","queue_duration_s":1.546732,"scheduling_latency_s":1.546749}1752gitlab # [ 315.236142] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.680Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c9d11fe5ee748085b605ebd","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c9d11fe5ee748085b605ebd: done: 0.014664 sec","job_status":"done","queue_duration_s":1.546732,"scheduling_latency_s":1.546749,"redis_calls":13,"redis_duration_s":0.001615,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000593,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014664,"completed_at":"2026-09-18T22:15:07.680Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1753gitlab # [ 315.274501] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.681Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70dbf8868bf3b78bd486f9fd","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70dbf8868bf3b78bd486f9fd: start","job_status":"start","queue_duration_s":1.562606,"scheduling_latency_s":1.562622}1754gitlab # [ 315.286531] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.695Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70dbf8868bf3b78bd486f9fd","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70dbf8868bf3b78bd486f9fd: done: 0.014069 sec","job_status":"done","queue_duration_s":1.562606,"scheduling_latency_s":1.562622,"redis_calls":13,"redis_duration_s":0.001465,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000945,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009716,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014069,"completed_at":"2026-09-18T22:15:07.695Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1755gitlab # [ 315.324869] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.697Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e21a9c14601c565a4f8affaf","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e21a9c14601c565a4f8affaf: start","job_status":"start","queue_duration_s":1.577806,"scheduling_latency_s":1.577823}1756gitlab # [ 315.337048] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.711Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e21a9c14601c565a4f8affaf","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e21a9c14601c565a4f8affaf: done: 0.014046 sec","job_status":"done","queue_duration_s":1.577806,"scheduling_latency_s":1.577823,"redis_calls":13,"redis_duration_s":0.00147,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000924,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009707,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014046,"completed_at":"2026-09-18T22:15:07.711Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1757gitlab # [ 315.375319] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90c707549558fcc06580027b","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90c707549558fcc06580027b: start","job_status":"start","queue_duration_s":1.592953,"scheduling_latency_s":1.592969}1758gitlab # [ 315.387661] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.726Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90c707549558fcc06580027b","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90c707549558fcc06580027b: done: 0.014338 sec","job_status":"done","queue_duration_s":1.592953,"scheduling_latency_s":1.592969,"redis_calls":13,"redis_duration_s":0.001483,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014338,"completed_at":"2026-09-18T22:15:07.726Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1759gitlab # [ 315.427599] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.727Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31ce8951dc4be78adb077649","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31ce8951dc4be78adb077649: start","job_status":"start","queue_duration_s":1.608402,"scheduling_latency_s":1.608419}1760gitlab # [ 315.440092] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.742Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31ce8951dc4be78adb077649","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31ce8951dc4be78adb077649: done: 0.014823 sec","job_status":"done","queue_duration_s":1.608402,"scheduling_latency_s":1.608419,"redis_calls":13,"redis_duration_s":0.001887,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000911,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014823,"completed_at":"2026-09-18T22:15:07.742Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1761gitlab # [ 315.479294] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91dc90d17c6331604da6a5c5","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91dc90d17c6331604da6a5c5: start","job_status":"start","queue_duration_s":1.62438,"scheduling_latency_s":1.624397}1762gitlab # [ 315.516417] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.758Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91dc90d17c6331604da6a5c5","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91dc90d17c6331604da6a5c5: done: 0.01459 sec","job_status":"done","queue_duration_s":1.62438,"scheduling_latency_s":1.624397,"redis_calls":13,"redis_duration_s":0.0015569999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010081,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01459,"completed_at":"2026-09-18T22:15:07.758Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1763gitlab # [ 315.586539] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.759Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa8ac86c15e449f5f8225d3d","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa8ac86c15e449f5f8225d3d: start","job_status":"start","queue_duration_s":1.640136,"scheduling_latency_s":1.640151}1764gitlab # [ 315.600784] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.773Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa8ac86c15e449f5f8225d3d","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa8ac86c15e449f5f8225d3d: done: 0.014134 sec","job_status":"done","queue_duration_s":1.640136,"scheduling_latency_s":1.640151,"redis_calls":13,"redis_duration_s":0.001415,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014134,"completed_at":"2026-09-18T22:15:07.773Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1765gitlab # [ 315.641191] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.774Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f64791eca200f1e44643b95d","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f64791eca200f1e44643b95d: start","job_status":"start","queue_duration_s":1.655361,"scheduling_latency_s":1.655378}1766gitlab # [ 315.653350] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:07.788Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f64791eca200f1e44643b95d","created_at":"2026-09-18T22:15:06.030Z","trace_propagation_headers":{"sentry-trace":"e6356d1d459249f5b3a8fce6b1d99ba5-ba1ee86cebf849e6","baggage":"sentry-trace_id=e6356d1d459249f5b3a8fce6b1d99ba5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4e6d433008e037273e3996ea0d08f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:06.119Z","job_size_bytes":2,"pid":2038,"sidekiq_tid":"maoa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f64791eca200f1e44643b95d: done: 0.01415 sec","job_status":"done","queue_duration_s":1.655361,"scheduling_latency_s":1.655378,"redis_calls":13,"redis_duration_s":0.001462,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01415,"completed_at":"2026-09-18T22:15:07.788Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1767gitlab # [ 328.395634] postgres[3384]: [3384] ERROR: relation "table_without_models" does not exist1768gitlab # [ 328.399389] postgres[3384]: [3384] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1769gitlab # [ 334.246673] runuser[3029]: pam_unix(runuser:session): session closed for user gitlab1770gitlab # [ 334.248539] setup-gitlab-start[3003]: + systemctl restart gitlab-sidekiq.service1771gitlab # [ 334.290209] systemd[1]: Stopping gitlab-sidekiq.service...1772gitlab # [ 334.291837] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:28.930Z","message":"Shutting down"}1773gitlab # [ 334.293757] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:28.931Z","message":"Scheduler exiting..."}1774gitlab # [ 334.295589] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:28.932Z","message":"Terminating quiet threads for default capsule"}1775gitlab # [ 334.297859] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:28.932Z","message":"Scheduler exiting..."}1776gitlab # [ 334.793964] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:29.434Z","message":"Pausing to allow jobs to finish..."}1777gitlab # [ 338.299198] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:32.938Z","message":"Bye!"}1778gitlab # [ 338.340658] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-09-18T22:15:32.980Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2038,"worker_id":"sidekiq_0","memwd_rss_bytes":938446848,"retry":0}1779gitlab # [ 339.217267] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1780gitlab # [ 339.217682] systemd[1]: Stopped gitlab-sidekiq.service.1781gitlab # [ 339.217890] systemd[1]: gitlab-sidekiq.service: Consumed 2min 3.443s CPU time over 3min 34.302s wall clock time, 938.5M memory peak, 4.4M read from disk.1782gitlab # [ 339.235476] systemd[1]: Started gitlab-sidekiq.service.1783gitlab # [ 339.239501] setup-gitlab-start[3003]: + mkdir -p /var/lib/secrets1784gitlab # [ 339.244969] setup-gitlab-start[3003]: + echo nixbot-test-token-of-20-chars1785gitlab # [ 339.247787] setup-gitlab-start[3003]: + chmod 644 /var/lib/secrets/gitlab-token1786gitlab # [ 339.254080] setup-gitlab-start[3003]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars1787gitlab # [ 340.071982] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:15:34 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 7761788gitlab # [ 341.646523] gitaly[920]: time="2026-09-18T22:15:36.286Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9DPJQ5TY4PJQMZX7WAYFG error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-18T22:15:46.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:15:36.285" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1789gitlab # [ 341.646770] gitaly[920]: time="2026-09-18T22:15:36.287Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9DPJQ5TY4PJQMZX7WAYFG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-18T22:15:46.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:15:36.285" grpc.time_ms=1.346 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1790gitlab # [ 342.141551] gitaly[920]: time="2026-09-18T22:15:36.782Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9DPJQ5TY4PJQMZX7WAYFG error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-18T22:15:46.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:15:36.781" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1791gitlab # [ 342.153319] gitaly[920]: time="2026-09-18T22:15:36.782Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9DPJQ5TY4PJQMZX7WAYFG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-18T22:15:46.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:15:36.781" grpc.time_ms=0.64 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1792gitlab # [ 342.232029] gitaly[920]: time="2026-09-18T22:15:36.872Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9DPJQ5TY4PJQMZX7WAYFG diskcache=a7ab246a-a048-44e4-8fca-293c4f362834 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-18T22:15:46.031" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:15:36.802" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1793gitlab # [ 342.251626] gitaly[920]: time="2026-09-18T22:15:36.873Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=37 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1437 command.oublock=32 command.real_time_ms=43 command.spawn_token_fork_ms=6 command.system_time_ms=21 command.user_time_ms=16 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9DPJQ5TY4PJQMZX7WAYFG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-18T22:15:46.031" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:15:36.802" grpc.time_ms=69.983 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1794gitlab # [ 342.287517] gitaly[920]: time="2026-09-18T22:15:36.927Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9DPJQ5TY4PJQMZX7WAYFG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-18T22:15:46.156" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:15:36.926" pid=920 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1795gitlab # [ 342.305654] gitaly[920]: time="2026-09-18T22:15:36.928Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9DPJQ5TY4PJQMZX7WAYFG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-18T22:15:46.156" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:15:36.926" grpc.time_ms=1.554 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1796gitlab # [ 342.341411] gitaly[920]: time="2026-09-18T22:15:36.981Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9DPJQ5TY4PJQMZX7WAYFG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-18T22:15:46.192" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:15:36.963" grpc.time_ms=17.838 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1797gitlab # [ 342.556902] gitaly[920]: time="2026-09-18T22:15:37.197Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9DPJQ5TY4PJQMZX7WAYFG error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-18T22:15:47.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:15:37.196" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1798gitlab # [ 342.589204] gitaly[920]: time="2026-09-18T22:15:37.197Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9DPJQ5TY4PJQMZX7WAYFG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-18T22:15:47.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:15:37.196" grpc.time_ms=0.617 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1799gitlab # [ 342.636130] gitaly[920]: time="2026-09-18T22:15:37.276Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9DPJQ5TY4PJQMZX7WAYFG diskcache=5dfa59e3-8e71-4742-a396-f7b6523c845e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-18T22:15:47.041" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:15:37.232" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1800gitlab # [ 342.665602] gitaly[920]: time="2026-09-18T22:15:37.277Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1438 command.oublock=32 command.real_time_ms=22 command.spawn_token_fork_ms=5 command.system_time_ms=14 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9DPJQ5TY4PJQMZX7WAYFG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-18T22:15:47.041" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:15:37.232" grpc.time_ms=44.479 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1801gitlab # [ 342.691768] gitaly[920]: time="2026-09-18T22:15:37.298Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9DPJQ5TY4PJQMZX7WAYFG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-18T22:15:47.015" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:15:37.296" pid=920 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1802gitlab # [ 342.707212] gitaly[920]: time="2026-09-18T22:15:37.299Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9DPJQ5TY4PJQMZX7WAYFG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-18T22:15:47.015" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:15:37.296" grpc.time_ms=2.024 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1803gitlab # [ 342.721009] gitaly[920]: time="2026-09-18T22:15:37.321Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9DPJQ5TY4PJQMZX7WAYFG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-18T22:15:47.024" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:15:37.305" grpc.time_ms=15.821 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1804gitlab # [ 342.819539] gitaly[920]: time="2026-09-18T22:15:37.459Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9DPJQ5TY4PJQMZX7WAYFG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-18T22:15:47.178" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:15:37.459" grpc.time_ms=0.372 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1805gitlab # [ 342.873308] gitaly[920]: time="2026-09-18T22:15:37.513Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9DPJQ5TY4PJQMZX7WAYFG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-18T22:15:47.231" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:15:37.512" grpc.time_ms=1.157 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1806gitlab # [ 344.425999] sidekiq-cluster[3453]: {"severity":"INFO","time":"2026-09-18T22:15:39.022Z","message":"Starting cluster with 1 processes"}1807gitlab # [ 344.685856] gitaly[920]: time="2026-09-18T22:15:39.325Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9DPJQ5TY4PJQMZX7WAYFG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-18T22:15:49.028" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:15:39.309" grpc.time_ms=16.039 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1808gitlab # [ 345.438650] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:15:40 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 53331809gitlab # [ 345.443685] setup-gitlab-start[3467]: {"id":1,"message":null,"error":null}1810gitlab # [ 350.685362] gitaly[920]: time="2026-09-18T22:15:45.324Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E0Q7PSRGWJAK5BA084MK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-18T22:15:55.025" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:15:45.306" grpc.time_ms=18.203 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1811gitlab # [ 350.864348] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:15:45 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 3751812gitlab # [ 350.871079] setup-gitlab-start[3003]: + mkdir -p /tmp/test-flake1813gitlab # [ 350.873718] setup-gitlab-start[3003]: + cd /tmp/test-flake1814gitlab # [ 350.876094] setup-gitlab-start[3003]: + git init -b master1815gitlab # [ 350.912508] setup-gitlab-start[3556]: Initialized empty Git repository in /tmp/test-flake/.git/1816gitlab # [ 350.916084] setup-gitlab-start[3003]: + git config user.name test1817gitlab # [ 350.918663] setup-gitlab-start[3003]: + git config user.email test@example.com1818gitlab # [ 350.924284] setup-gitlab-start[3003]: + cat1819gitlab # [ 350.929174] setup-gitlab-start[3003]: + git add flake.nix1820gitlab # [ 350.936317] setup-gitlab-start[3003]: + git commit -m 'initial commit'1821gitlab # [ 350.969916] setup-gitlab-start[3561]: [master (root-commit) 76405ab] initial commit1822gitlab # [ 350.974917] setup-gitlab-start[3561]: 1 file changed, 10 insertions(+)1823gitlab # [ 350.977798] setup-gitlab-start[3561]: create mode 100644 flake.nix1824gitlab # [ 350.980407] setup-gitlab-start[3003]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1825gitlab # [ 350.986150] setup-gitlab-start[3003]: + git push -u origin master1826gitlab # [ 351.119028] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:15:45 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 831827gitlab # [ 351.317512] gitaly[920]: time="2026-09-18T22:15:45.957Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M2V9E1B1XBXK5PQP4DTKBJS2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:15:45.937" grpc.time_ms=19.718 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1828gitlab # [ 351.350558] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:15:45 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 1971829gitlab # [ 351.751949] gitaly[920]: time="2026-09-18T22:15:46.391Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-18T22:15:56.091" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:15:46.372" grpc.time_ms=18.465 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1830gitlab # [ 351.844485] gitaly[920]: time="2026-09-18T22:15:46.484Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=5 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-18T22:16:16.064" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-18T22:15:46.465" grpc.time_ms=19.333 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1831gitlab # [ 351.899920] gitaly[920]: time="2026-09-18T22:15:46.540Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN duration_ms=295ns method=POST pid=920 status=200 url="http://unix/api/v4/internal/allowed"1832gitlab # [ 351.969804] gitaly[920]: time="2026-09-18T22:15:46.610Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN duration_ms=68ns method=POST pid=920 status=200 url="http://unix/api/v4/internal/pre_receive"1833gitlab # [ 351.984358] gitaly[920]: time="2026-09-18T22:15:46.611Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5313 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T22:15:46.242" grpc.time_ms=368.94 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1834gitlab # [ 352.075872] gitaly[920]: time="2026-09-18T22:15:46.716Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T22:15:46.713" grpc.time_ms=2.054 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1835gitlab # [ 352.138032] gitaly[920]: time="2026-09-18T22:15:46.778Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T22:15:46.777" grpc.time_ms=1.01 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1836gitlab # [ 352.192907] gitaly[920]: time="2026-09-18T22:15:46.833Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T22:15:46.831" grpc.time_ms=1.604 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1837gitlab # [ 352.402797] gitaly[920]: time="2026-09-18T22:15:47.043Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-18T22:15:57.004" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:15:47.025" grpc.time_ms=17.601 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1838gitlab # [ 352.443895] gitaly[920]: time="2026-09-18T22:15:47.084Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1433 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=5 command.system_time_ms=16 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-18T22:15:57.033" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:15:47.054" grpc.time_ms=29.676 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1839gitlab # [ 352.480846] gitaly[920]: time="2026-09-18T22:15:47.098Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN duration_ms=178ns method=POST pid=920 status=200 url="http://unix/api/v4/internal/post_receive"1840gitlab # [ 352.489231] gitaly[920]: time="2026-09-18T22:15:47.099Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4807 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T22:15:46.918" grpc.time_ms=180.546 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1841gitlab # [ 352.511224] gitaly[920]: time="2026-09-18T22:15:47.114Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN diskcache=fa3861e1-1a78-4ebb-b613-098ada4282c6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:15:46.118" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1842gitlab # [ 352.527899] setup-gitlab-start[3565]: To http://gitlab/root/test-flake.git1843gitlab # [ 352.529367] setup-gitlab-start[3565]: * [new branch] master -> master1844gitlab # [ 352.530639] setup-gitlab-start[3565]: branch 'master' set up to track 'origin/master'.1845gitlab # [ 352.532605] gitlab-workhorse[822]: time="2026-09-18T22:15:47Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521846gitlab # [ 352.535098] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:15:47 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 11351847gitlab # [ 352.538007] systemd[1]: Finished setup-gitlab.service.1848gitlab # [ 352.539123] gitaly[920]: time="2026-09-18T22:15:47.114Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=387 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13633 command.oublock=32 command.real_time_ms=986 command.spawn_token_fork_ms=2 command.system_time_ms=199 command.user_time_ms=188 component=gitaly.StreamServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:15:46.118" grpc.time_ms=996.51 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1849gitlab # [ 352.555628] systemd[1]: Starting nixbot CI service...1850gitlab: (finished: waiting for unit setup-gitlab.service, in 353.60 seconds)1851gitlab: waiting for unit nixbot.service1852gitlab # [ 353.968399] nixbot[3643]: {"ts": "2026-09-18T22:15:48.607Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1853gitlab # [ 353.999428] nixbot[3643]: {"ts": "2026-09-18T22:15:48.639Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1854gitlab # [ 354.043522] nixbot[3643]: {"ts": "2026-09-18T22:15:48.683Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1855gitlab # [ 354.052743] nixbot[3643]: {"ts": "2026-09-18T22:15:48.693Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1856gitlab # [ 354.060976] nixbot[3643]: {"ts": "2026-09-18T22:15:48.701Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1857gitlab # [ 354.073123] nixbot[3643]: {"ts": "2026-09-18T22:15:48.713Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1858gitlab # [ 354.080948] nixbot[3643]: {"ts": "2026-09-18T22:15:48.721Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1859gitlab # [ 354.085383] nixbot[3643]: {"ts": "2026-09-18T22:15:48.725Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1860gitlab # [ 354.096486] nixbot[3643]: {"ts": "2026-09-18T22:15:48.736Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1861gitlab # [ 354.101133] nixbot[3643]: {"ts": "2026-09-18T22:15:48.740Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1862gitlab # [ 354.109974] nixbot[3643]: {"ts": "2026-09-18T22:15:48.750Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1863gitlab # [ 354.122303] nixbot[3643]: {"ts": "2026-09-18T22:15:48.762Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1864gitlab # [ 354.128683] nixbot[3643]: {"ts": "2026-09-18T22:15:48.769Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1865gitlab # [ 354.133876] nixbot[3643]: {"ts": "2026-09-18T22:15:48.772Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1866gitlab # [ 354.139277] nixbot[3643]: {"ts": "2026-09-18T22:15:48.779Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1867gitlab # [ 354.144549] nixbot[3643]: {"ts": "2026-09-18T22:15:48.782Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1868gitlab # [ 354.149614] nixbot[3643]: {"ts": "2026-09-18T22:15:48.786Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1869gitlab # [ 354.155037] nixbot[3643]: {"ts": "2026-09-18T22:15:48.788Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1870gitlab # [ 354.159755] nixbot[3643]: {"ts": "2026-09-18T22:15:48.797Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1871gitlab # [ 354.166278] nixbot[3643]: {"ts": "2026-09-18T22:15:48.800Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1872gitlab # [ 354.172317] nixbot[3643]: {"ts": "2026-09-18T22:15:48.803Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1873gitlab # [ 354.176437] nixbot[3643]: {"ts": "2026-09-18T22:15:48.814Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1874gitlab # [ 354.180618] nixbot[3643]: {"ts": "2026-09-18T22:15:48.817Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1875gitlab # [ 354.184712] nixbot[3643]: {"ts": "2026-09-18T22:15:48.821Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1876gitlab # [ 354.188727] nixbot[3643]: {"ts": "2026-09-18T22:15:48.823Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1877gitlab # [ 354.192880] nixbot[3643]: {"ts": "2026-09-18T22:15:48.828Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1878gitlab # [ 354.196820] nixbot[3643]: {"ts": "2026-09-18T22:15:48.831Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1879gitlab # [ 354.200521] nixbot[3643]: {"ts": "2026-09-18T22:15:48.833Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1880gitlab # [ 354.203925] nixbot[3643]: {"ts": "2026-09-18T22:15:48.835Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1881gitlab # [ 354.212403] nixbot[3643]: {"ts": "2026-09-18T22:15:48.852Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1882gitlab # [ 354.218453] nixbot[3643]: {"ts": "2026-09-18T22:15:48.858Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1883gitlab # [ 354.222361] nixbot[3643]: {"ts": "2026-09-18T22:15:48.861Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1884gitlab # [ 354.227166] nixbot[3643]: {"ts": "2026-09-18T22:15:48.863Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1885gitlab # [ 354.230925] nixbot[3643]: {"ts": "2026-09-18T22:15:48.869Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "effect_runs_catchup"}1886gitlab # [ 354.234635] nixbot[3643]: {"ts": "2026-09-18T22:15:48.871Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 34, "migration": "public_badges"}1887gitlab # [ 354.238257] nixbot[3643]: {"ts": "2026-09-18T22:15:48.878Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 35, "migration": "settle_reset_effects"}1888gitlab # [ 354.241857] nixbot[3643]: {"ts": "2026-09-18T22:15:48.881Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 36, "migration": "pr_approvals"}1889gitlab # [ 354.733669] nixbot[3643]: INFO: Started server process [3643]1890gitlab # [ 354.737130] nixbot[3643]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1891gitlab # [ 354.757437] nixbot[3643]: INFO: ::ffff:127.0.0.1:56434 - "GET /health HTTP/1.1" 200 OK1892gitlab # [ 354.767833] systemd[1]: Started nixbot CI service.1893gitlab # [ 354.771255] systemd[1]: Reached target Multi-User System.1894gitlab # [ 354.773800] systemd[1]: Startup finished in 1.017s (kernel) + 4.501s (initrd) + 5min 49.252s (userspace) = 5min 54.771s.1895gitlab # [ 355.125523] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:15:49 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 3621896gitlab # [ 355.136496] nixbot[3643]: {"ts": "2026-09-18T22:15:49.761Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1897gitlab # [ 355.186109] nixbot[3643]: {"ts": "2026-09-18T22:15:49.826Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1898gitlab: (finished: waiting for unit nixbot.service, in 2.16 seconds)1899gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1900gitlab # [ 355.308706] nixbot[3643]: INFO: ::ffff:127.0.0.1:56448 - "GET /health HTTP/1.1" 200 OK1901gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1902subtest: project discovered and webhook registered1903gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1904gitlab # [ 355.337449] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:15:49 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1341905gitlab # [ 355.346172] nixbot[3643]: {"ts": "2026-09-18T22:15:49.980Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1906gitlab # [ 355.352493] nixbot[3643]: {"ts": "2026-09-18T22:15:49.984Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1907gitlab # [ 355.556573] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:15:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 918 "" "python-httpx/0.28.1" 2011908gitlab # [ 355.564296] nixbot[3643]: {"ts": "2026-09-18T22:15:50.192Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1909gitlab # [ 355.905411] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:15:50 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "curl/8.21.0" 5351910gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.60 seconds)1911(finished: subtest: project discovered and webhook registered, in 0.60 seconds)1912subtest: push delivers the webhook1913gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails'1914gitlab # [ 355.982268] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:15:50 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 4001915gitlab # [ 355.985713] nixbot[3643]: {"ts": "2026-09-18T22:15:50.623Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1916gitlab # [ 356.067371] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:15:50 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "python-httpx/0.28.1" 741917gitlab # [ 356.070969] nixbot[3643]: {"ts": "2026-09-18T22:15:50.710Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1918gitlab # [ 356.162306] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:15:50 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 918 "" "python-httpx/0.28.1" 821919gitlab # [ 356.170117] nixbot[3643]: {"ts": "2026-09-18T22:15:50.802Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1920gitlab # [ 356.253318] gitaly[920]: time="2026-09-18T22:15:50.893Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=3 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E68R42A8X2ED4JZ3GVB2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-18T22:16:20.468" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:15:50.869" grpc.time_ms=22.855 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1921gitlab # [ 356.286345] gitaly[920]: time="2026-09-18T22:15:50.926Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E68R42A8X2ED4JZ3GVB2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T22:16:20.524" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:15:50.925" grpc.time_ms=1.031 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1922gitlab # [ 356.310764] gitaly[920]: time="2026-09-18T22:15:50.951Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=11 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E68R42A8X2ED4JZ3GVB2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-18T22:16:00.162" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:15:50.933" grpc.time_ms=17.57 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1923gitlab # [ 356.369413] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:15:51 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 2001924gitlab # [ 356.377208] nixbot[3643]: {"ts": "2026-09-18T22:15:51.011Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1925gitlab # [ 356.578338] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:15:51 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 2011926gitlab # [ 356.586136] nixbot[3643]: {"ts": "2026-09-18T22:15:51.219Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1927gitlab # [ 356.594369] nixbot[3643]: {"ts": "2026-09-18T22:15:51.225Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1928gitlab # [ 356.772234] gitaly[920]: time="2026-09-18T22:15:51.412Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M2V9E6R4H1ABX4T2BYDWQPHA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:15:51.393" grpc.time_ms=18.49 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1929gitlab # [ 356.810075] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:15:51 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1131930gitlab # [ 357.120791] gitaly[920]: time="2026-09-18T22:15:51.761Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E6VRFV58S0ENS39HHCS3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:15:51.742" pid=920 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1931gitlab # [ 357.150779] gitaly[920]: time="2026-09-18T22:15:51.761Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E6VRFV58S0ENS39HHCS3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:15:51.742" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1932gitlab # [ 357.184278] gitlab-workhorse[822]: time="2026-09-18T22:15:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131933gitlab # [ 357.188143] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:15:51 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 3461934gitlab # [ 357.191790] gitaly[920]: time="2026-09-18T22:15:51.761Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E6VRFV58S0ENS39HHCS3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:15:51.742" grpc.time_ms=19.203 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1935gitlab # [ 357.270502] gitaly[920]: time="2026-09-18T22:15:51.909Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E77KET8P36HMEA173NRC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:15:51.874" pid=920 remote_ip="2001:db8:1::1" request_sha=c0b3cd73d8b5f7d86202a3e41906ba9915f500cb response_bytes=223 span.kind=server system=grpc1936gitlab # [ 357.300997] gitaly[920]: time="2026-09-18T22:15:51.910Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=29 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1135 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=2 command.system_time_ms=18 command.user_time_ms=11 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E77KET8P36HMEA173NRC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:15:51.874" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1937gitlab # [ 357.333660] gitlab-workhorse[822]: time="2026-09-18T22:15:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231938gitlab # [ 357.337316] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:15:51 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 1171939gitlab # [ 357.340738] gitaly[920]: time="2026-09-18T22:15:51.910Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=29 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1135 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=2 command.system_time_ms=18 command.user_time_ms=11 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E77KET8P36HMEA173NRC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:15:51.874" grpc.time_ms=35.678 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1940gitlab # [ 357.450495] gitaly[920]: time="2026-09-18T22:15:52.090Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9E7DFMR2K7NHP7VG5S1S1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:15:52.072" grpc.time_ms=18.353 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1941gitlab # [ 357.488972] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:15:52 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1071942gitlab # [ 357.568143] gitaly[920]: time="2026-09-18T22:15:52.207Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E7GY83WQ0V9NE3KPXVS1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:15:52.179" pid=920 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1943gitlab # [ 357.597829] gitaly[920]: time="2026-09-18T22:15:52.208Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=22 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E7GY83WQ0V9NE3KPXVS1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:15:52.179" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1944gitlab # [ 357.625888] gitlab-workhorse[822]: time="2026-09-18T22:15:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671945gitlab # [ 357.629167] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:15:52 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1151946gitlab # [ 357.632217] gitaly[920]: time="2026-09-18T22:15:52.208Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=22 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E7GY83WQ0V9NE3KPXVS1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:15:52.179" grpc.time_ms=28.865 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1947gitlab # [ 357.771154] gitaly[920]: time="2026-09-18T22:15:52.411Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=577 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M2V9E7PZK2YYBPNADWYYE9B3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:15:52.391" grpc.time_ms=19.499 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1948gitlab # [ 357.789381] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:15:52 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1261949gitlab # [ 357.983732] gitaly[920]: time="2026-09-18T22:15:52.623Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E7V29J8XYG0AK1XAFCTR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:15:52.588" pid=920 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1950gitlab # [ 358.012143] gitaly[920]: time="2026-09-18T22:15:52.623Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=29 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=2 command.system_time_ms=18 command.user_time_ms=11 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E7V29J8XYG0AK1XAFCTR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:15:52.588" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1951gitlab # [ 358.045124] gitlab-workhorse[822]: time="2026-09-18T22:15:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091952gitlab # [ 358.048254] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:15:52 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 2061953gitlab # [ 358.051205] gitaly[920]: time="2026-09-18T22:15:52.624Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=29 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=2 command.system_time_ms=18 command.user_time_ms=11 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E7V29J8XYG0AK1XAFCTR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:15:52.588" grpc.time_ms=35.653 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1954gitlab # [ 358.187233] gitaly[920]: time="2026-09-18T22:15:52.827Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E84W14M2VACDVXZN77T8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T22:16:22.425" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:15:52.826" grpc.time_ms=1.435 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1955gitlab # [ 358.278094] gitaly[920]: time="2026-09-18T22:15:52.917Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=587 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9E84W14M2VACDVXZN77T8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-18T22:16:22.496" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:15:52.897" grpc.time_ms=19.417 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1956gitlab # [ 358.363961] gitaly[920]: time="2026-09-18T22:15:53.004Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9E84W14M2VACDVXZN77T8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T22:16:02.213" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:15:52.984" grpc.time_ms=19.67 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1957gitlab # [ 358.408505] gitaly[920]: time="2026-09-18T22:15:53.048Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=3 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9E84W14M2VACDVXZN77T8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T22:16:03.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:15:53.029" grpc.time_ms=19.202 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1958gitlab # [ 358.590043] gitaly[920]: time="2026-09-18T22:15:53.230Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E84W14M2VACDVXZN77T8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-18T22:16:03.035" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:15:53.227" grpc.time_ms=1.309 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1959gitlab # [ 358.639378] gitaly[920]: time="2026-09-18T22:15:53.279Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=568 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E84W14M2VACDVXZN77T8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-18T22:16:03.068" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:15:53.259" grpc.time_ms=19.98 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1960gitlab # [ 358.739264] gitaly[920]: time="2026-09-18T22:15:53.379Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V9E84W14M2VACDVXZN77T8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T22:15:53.378" grpc.time_ms=1.052 pid=920 span.kind=server system=grpc1961gitlab # [ 358.787861] gitaly[920]: time="2026-09-18T22:15:53.428Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V9E84W14M2VACDVXZN77T8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T22:15:53.427" grpc.time_ms=0.691 pid=920 span.kind=server system=grpc1962gitlab # [ 358.817491] gitaly[920]: time="2026-09-18T22:15:53.445Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E84W14M2VACDVXZN77T8 diskcache=0592a2af-5272-4df6-a033-eb119bd0c7e7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-18T22:16:03.004" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:15:53.285" pid=920 ref=refs/keep-around/76405abae0e94d03d2675e46abc4a7b5dd2e80c1 remote_ip="2001:db8:1::1" revision=76405abae0e94d03d2675e46abc4a7b5dd2e80c1 span.kind=server system=grpc username=root1963gitlab # [ 358.843987] gitaly[920]: time="2026-09-18T22:15:53.446Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=148 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5054 command.oublock=8 command.real_time_ms=147 command.spawn_token_fork_ms=2 command.system_time_ms=83 command.user_time_ms=65 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E84W14M2VACDVXZN77T8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-18T22:16:03.004" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:15:53.285" grpc.time_ms=160.349 pid=920 ref=refs/keep-around/76405abae0e94d03d2675e46abc4a7b5dd2e80c1 remote_ip="2001:db8:1::1" revision=76405abae0e94d03d2675e46abc4a7b5dd2e80c1 span.kind=server system=grpc username=root1964gitlab # [ 358.867422] gitaly[920]: time="2026-09-18T22:15:53.453Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E84W14M2VACDVXZN77T8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T22:16:23.051" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:15:53.452" grpc.time_ms=0.73 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1965gitlab # [ 359.134933] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:15:53 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/76405abae0e94d03d2675e46abc4a7b5dd2e80c1 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 10411966gitlab # [ 359.140364] nixbot[3643]: {"ts": "2026-09-18T22:15:53.775Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/76405abae0e94d03d2675e46abc4a7b5dd2e80c1 \"HTTP/1.1 201 Created\""}1967gitlab # [ 359.153735] nixbot[3643]: {"ts": "2026-09-18T22:15:53.794Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-76405abae0e9-0"}1968gitlab # [ 359.433423] nixbot[3643]: {"ts": "2026-09-18T22:15:54.073Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-76405abae0e9-0", "argv0": "bwrap"}1969gitlab # [ 359.615399] systemd[1]: Started Nix Daemon.1970gitlab # [ 359.758033] nix-daemon[3814]: accepted connection from pid 3809, user nixbot1971gitlab # [ 364.627306] nix-daemon[3814]: accepted connection from pid 3864, user nixbot1972gitlab # [ 364.655841] nix-daemon[3814]: accepted connection from pid 3809, user nixbot1973gitlab # [ 368.923638] nix-daemon[3814]: accepted connection from pid 3809, user nixbot1974gitlab # [ 369.221232] gitaly[920]: time="2026-09-18T22:16:03.860Z" level=info msg="finished unary call with code OK" catfile.duration_ms=7 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=7 catfile.request_object_count=1 catfile.request_object_ms=0 command.spawn_token_fork_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9EJTMANPPV3JPNZ06Z6SS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T22:16:33.049" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:16:03.850" grpc.time_ms=10.093 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1975gitlab # [ 369.920835] gitaly[920]: time="2026-09-18T22:16:04.561Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M2V9EJTMANPPV3JPNZ06Z6SS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T22:16:14.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:16:04.549" grpc.time_ms=11.469 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1976gitlab # [ 370.185059] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:16:04 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/76405abae0e94d03d2675e46abc4a7b5dd2e80c1 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 11551977gitlab # [ 370.191487] nixbot[3643]: {"ts": "2026-09-18T22:16:04.827Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/76405abae0e94d03d2675e46abc4a7b5dd2e80c1 \"HTTP/1.1 201 Created\""}1978gitlab # [ 370.330107] gitaly[920]: time="2026-09-18T22:16:04.969Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9EKZ4HBYV5KNWG2D6KE8B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T22:16:34.167" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:16:04.967" grpc.time_ms=1.408 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1979gitlab # [ 370.401785] gitaly[920]: time="2026-09-18T22:16:05.042Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9EKZ4HBYV5KNWG2D6KE8B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T22:16:15.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:16:05.023" grpc.time_ms=18.567 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1980gitlab # [ 370.527115] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:16:05 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/76405abae0e94d03d2675e46abc4a7b5dd2e80c1 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 3301981gitlab # [ 370.542149] nixbot[3643]: {"ts": "2026-09-18T22:16:05.177Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/76405abae0e94d03d2675e46abc4a7b5dd2e80c1 \"HTTP/1.1 201 Created\""}1982gitlab # [ 370.673604] gitaly[920]: time="2026-09-18T22:16:05.314Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9EMAEK6ZN4774QVBTFBQ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T22:16:35.011" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:16:05.312" grpc.time_ms=1.648 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1983gitlab # [ 370.782841] gitaly[920]: time="2026-09-18T22:16:05.423Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=7 command.system_time_ms=14 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M2V9EMAEK6ZN4774QVBTFBQ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T22:16:15.204" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:16:05.395" grpc.time_ms=27.789 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1984gitlab # [ 370.925657] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:16:05 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/76405abae0e94d03d2675e46abc4a7b5dd2e80c1 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 3671985gitlab # [ 370.934953] nixbot[3643]: {"ts": "2026-09-18T22:16:05.568Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/76405abae0e94d03d2675e46abc4a7b5dd2e80c1 \"HTTP/1.1 201 Created\""}1986gitlab # [ 371.620702] gitaly[920]: time="2026-09-18T22:16:06.259Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=3 command.system_time_ms=16 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9EN7F83VA9YYVZ1XNBM4V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:16:06.237" grpc.time_ms=21.617 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1987gitlab # [ 371.622321] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:16:06 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1341988gitlab # [ 371.782660] gitaly[920]: time="2026-09-18T22:16:06.423Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9ENBS8AB006RMY19XYJ5H grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:16:06.401" pid=920 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1989gitlab # [ 371.822027] gitaly[920]: time="2026-09-18T22:16:06.423Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9ENBS8AB006RMY19XYJ5H grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:16:06.401" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1990gitlab # [ 371.852599] gitlab-workhorse[822]: time="2026-09-18T22:16:06Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671991gitlab # [ 371.855904] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:16:06 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1591992gitlab # [ 371.863384] gitaly[920]: time="2026-09-18T22:16:06.424Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9ENBS8AB006RMY19XYJ5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:16:06.401" grpc.time_ms=21.85 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1993gitlab # [ 371.988316] gitaly[920]: time="2026-09-18T22:16:06.628Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M2V9ENK5E49Q3CRMHSKVQR0P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:16:06.614" grpc.time_ms=13.835 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1994gitlab # [ 372.026642] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:16:06 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1271995gitlab # [ 372.111035] gitaly[920]: time="2026-09-18T22:16:06.751Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9ENQEDRKJERJYSAK5J4XD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:16:06.730" pid=920 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1996gitlab # [ 372.139566] gitaly[920]: time="2026-09-18T22:16:06.751Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=3 command.system_time_ms=16 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9ENQEDRKJERJYSAK5J4XD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:16:06.730" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1997gitlab # [ 372.164641] gitlab-workhorse[822]: time="2026-09-18T22:16:06Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671998gitlab # [ 372.167603] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:16:06 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1141999gitlab # [ 372.170610] gitaly[920]: time="2026-09-18T22:16:06.752Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=3 command.system_time_ms=16 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9ENQEDRKJERJYSAK5J4XD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:16:06.730" grpc.time_ms=21.628 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2000gitlab # [ 389.678387] sidekiq-cluster[3513]: 2026-09-18T22:16:24.317Z pid=3513 tid=ykx INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3513, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>431902720}2001gitlab # [ 389.991716] sidekiq-cluster[3513]: W, [2026-09-18T22:16:24.632123 #3513] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.2002gitlab # [ 390.063629] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:16:24.704Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}2003gitlab # [ 393.752671] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:16:28.391Z","message":"GitLab reliable fetch activated!"}2004gitlab # [ 393.753077] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:16:28.392Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2005gitlab # [ 435.872090] postgres[4430]: [4430] ERROR: relation "table_without_models" does not exist2006gitlab # [ 435.872761] postgres[4430]: [4430] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2007gitlab # [ 441.030164] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:15.669Z","message":"Booted Rails 7.2.3.1 application in production environment"}2008gitlab # [ 441.036590] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:15.677Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}2009gitlab # [ 441.042716] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:15.677Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2010gitlab # [ 441.048132] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:15.677Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2011gitlab # [ 441.054156] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:15.678Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2012gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 86.19 seconds)2013gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master2014gitlab # [ 442.394902] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:17 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 1922015gitlab # [ 442.633068] gitaly[920]: time="2026-09-18T22:17:17.272Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=3 command.system_time_ms=17 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9GTFDGS9TG14VHAY5WA69 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:17:17.246" grpc.time_ms=25.601 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2016gitlab # [ 442.652318] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:17 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 2362017gitlab # Enumerating objects: 5, done.2018gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.2019gitlab # Delta compression using up to 4 threads2020gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.2021gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 68.00 KiB/s, done.2022gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)2023gitlab # [ 443.257996] gitaly[920]: time="2026-09-18T22:17:17.898Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9GTRNNR62RGJVFPBY7CY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-18T22:17:47.578" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-18T22:17:17.878" grpc.time_ms=19.672 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2024gitlab # [ 443.299157] gitaly[920]: time="2026-09-18T22:17:17.939Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M2V9GTRNNR62RGJVFPBY7CY9 duration_ms=186ns method=POST pid=920 status=200 url="http://unix/api/v4/internal/allowed"2025gitlab # [ 443.361571] gitaly[920]: time="2026-09-18T22:17:18.002Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M2V9GTRNNR62RGJVFPBY7CY9 duration_ms=61ns method=POST pid=920 status=200 url="http://unix/api/v4/internal/pre_receive"2026gitlab # [ 443.370622] gitaly[920]: time="2026-09-18T22:17:18.002Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V9GTRNNR62RGJVFPBY7CY9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5313 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T22:17:17.750" grpc.time_ms=251.501 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2027gitlab # [ 443.409498] gitaly[920]: time="2026-09-18T22:17:18.050Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V9GTRNNR62RGJVFPBY7CY9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T22:17:18.048" grpc.time_ms=1.587 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2028gitlab # [ 443.466564] gitaly[920]: time="2026-09-18T22:17:18.107Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V9GTRNNR62RGJVFPBY7CY9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T22:17:18.106" grpc.time_ms=0.801 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2029gitlab # [ 443.513741] gitaly[920]: time="2026-09-18T22:17:18.154Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V9GTRNNR62RGJVFPBY7CY9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T22:17:18.153" grpc.time_ms=0.809 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2030gitlab # [ 443.752662] gitaly[920]: time="2026-09-18T22:17:18.391Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M2V9GTRNNR62RGJVFPBY7CY9 duration_ms=199ns method=POST pid=920 status=200 url="http://unix/api/v4/internal/post_receive"2031gitlab # [ 443.764361] gitaly[920]: time="2026-09-18T22:17:18.392Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V9GTRNNR62RGJVFPBY7CY9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4807 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T22:17:18.190" grpc.time_ms=201.877 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2032gitlab # [ 443.800750] gitaly[920]: time="2026-09-18T22:17:18.441Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M2V9GTRNNR62RGJVFPBY7CY9 diskcache=d38089bf-deff-4275-9934-725b9a38b540 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:17:17.619" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2033gitlab # To http://gitlab/root/test-flake.git2034gitlab # [ 443.829621] gitaly[920]: time="2026-09-18T22:17:18.442Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=328 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13234 command.oublock=32 command.real_time_ms=811 command.spawn_token_fork_ms=2 command.system_time_ms=194 command.user_time_ms=134 component=gitaly.StreamServerInterceptor correlation_id=01M2V9GTRNNR62RGJVFPBY7CY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:17:17.619" grpc.time_ms=822.059 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2035gitlab # 76405ab..a4bc83d [ 443.856700] gitlab-workhorse[822]: time="2026-09-18T22:17:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=522036gitlab # master -> master[ 443.859856] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:18 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 11102037gitlab # 2038gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.78 seconds)2039gitlab: must succeed: git -C /tmp/test-flake rev-parse master2040gitlab # [ 443.878690] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:18.518Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"34209e41798bf1ede2c64066","created_at":"2026-09-18T22:15:37.023Z","trace_propagation_headers":{"sentry-trace":"8442a37ae37840eea66574f8988ca524-74a157648456428d","baggage":"sentry-trace_id=8442a37ae37840eea66574f8988ca524,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9DPJQ5TY4PJQMZX7WAYFG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:37.106Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-34209e41798bf1ede2c64066: start","job_status":"start","queue_duration_s":101.411562,"scheduling_latency_s":101.411621}2041gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.05 seconds)2042gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9'2043gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9', in 0.09 seconds)2044gitlab # [ 444.020214] nixbot[3643]: INFO: ::ffff:127.0.0.1:59828 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9 HTTP/1.1" 200 OK2045gitlab # [ 444.191389] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:18.831Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"34209e41798bf1ede2c64066","created_at":"2026-09-18T22:15:37.023Z","trace_propagation_headers":{"sentry-trace":"8442a37ae37840eea66574f8988ca524-74a157648456428d","baggage":"sentry-trace_id=8442a37ae37840eea66574f8988ca524,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9DPJQ5TY4PJQMZX7WAYFG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:37.106Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-34209e41798bf1ede2c64066: done: 0.313029 sec","job_status":"done","queue_duration_s":101.411562,"scheduling_latency_s":101.411621,"redis_calls":23,"redis_duration_s":0.011198,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.005899,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00323,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002069,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.172414,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.16566102,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.313029,"completed_at":"2026-09-18T22:17:18.830Z","load_balancing_strategy":"primary","db_duration_s":0.100305,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2046gitlab # [ 444.288557] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:18.833Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"ddc671951210b27f5f97c835","created_at":"2026-09-18T22:15:37.168Z","trace_propagation_headers":{"sentry-trace":"8442a37ae37840eea66574f8988ca524-74a157648456428d","baggage":"sentry-trace_id=8442a37ae37840eea66574f8988ca524,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9DPJQ5TY4PJQMZX7WAYFG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:37.181Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-ddc671951210b27f5f97c835: start","job_status":"start","queue_duration_s":101.652259,"scheduling_latency_s":101.652295}2047gitlab # [ 444.421903] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:19.061Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"ddc671951210b27f5f97c835","created_at":"2026-09-18T22:15:37.168Z","trace_propagation_headers":{"sentry-trace":"8442a37ae37840eea66574f8988ca524-74a157648456428d","baggage":"sentry-trace_id=8442a37ae37840eea66574f8988ca524,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9DPJQ5TY4PJQMZX7WAYFG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:37.181Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-ddc671951210b27f5f97c835: done: 0.227876 sec","job_status":"done","queue_duration_s":101.652259,"scheduling_latency_s":101.652295,"redis_calls":14,"redis_duration_s":0.005587,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000842,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002847,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001898,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.174946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.18027216,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.227876,"completed_at":"2026-09-18T22:17:19.061Z","load_balancing_strategy":"primary","db_duration_s":0.042321,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2048gitlab # [ 444.505094] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:19.064Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"651f779b94c01fe09f7d8f9b","created_at":"2026-09-18T22:15:39.104Z","trace_propagation_headers":{"sentry-trace":"8442a37ae37840eea66574f8988ca524-74a157648456428d","baggage":"sentry-trace_id=8442a37ae37840eea66574f8988ca524,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9DPJQ5TY4PJQMZX7WAYFG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:39.111Z","job_size_bytes":5,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-651f779b94c01fe09f7d8f9b: start","job_status":"start","queue_duration_s":99.952896,"scheduling_latency_s":99.952934}2049gitlab # [ 444.754649] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:19.394Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"651f779b94c01fe09f7d8f9b","created_at":"2026-09-18T22:15:39.104Z","trace_propagation_headers":{"sentry-trace":"8442a37ae37840eea66574f8988ca524-74a157648456428d","baggage":"sentry-trace_id=8442a37ae37840eea66574f8988ca524,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9DPJQ5TY4PJQMZX7WAYFG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:39.111Z","job_size_bytes":5,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-651f779b94c01fe09f7d8f9b: done: 0.329898 sec","job_status":"done","queue_duration_s":99.952896,"scheduling_latency_s":99.952934,"redis_calls":12,"redis_duration_s":0.004797,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001004,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003115,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000678,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.267199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006582,"duration_s":0.329898,"completed_at":"2026-09-18T22:17:19.394Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.054035,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2050gitlab # [ 444.862387] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:19.397Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"af67663a0a03dd8f2971af47","created_at":"2026-09-18T22:15:39.169Z","trace_propagation_headers":{"sentry-trace":"8442a37ae37840eea66574f8988ca524-74a157648456428d","baggage":"sentry-trace_id=8442a37ae37840eea66574f8988ca524,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9DPJQ5TY4PJQMZX7WAYFG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:39.182Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-af67663a0a03dd8f2971af47: start","job_status":"start","queue_duration_s":100.214109,"scheduling_latency_s":100.214137}2051gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9'2052gitlab # [ 445.081250] nixbot[3643]: INFO: ::ffff:127.0.0.1:59838 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9 HTTP/1.1" 200 OK2053gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9', in 0.06 seconds)2054gitlab # [ 445.102977] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:19.741Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"af67663a0a03dd8f2971af47","created_at":"2026-09-18T22:15:39.169Z","trace_propagation_headers":{"sentry-trace":"8442a37ae37840eea66574f8988ca524-74a157648456428d","baggage":"sentry-trace_id=8442a37ae37840eea66574f8988ca524,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9DPJQ5TY4PJQMZX7WAYFG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:39.182Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-af67663a0a03dd8f2971af47: done: 0.344632 sec","job_status":"done","queue_duration_s":100.214109,"scheduling_latency_s":100.214137,"redis_calls":11,"redis_duration_s":0.005215,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00091,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002764,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001541,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.049,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.28,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.28,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.047,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.219222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0010404,"duration_s":0.344632,"completed_at":"2026-09-18T22:17:19.741Z","load_balancing_strategy":"primary","db_duration_s":0.126309,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2055gitlab # [ 445.169956] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:19.746Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"0fb6a52debdebe5a38a62dff","created_at":"2026-09-18T22:15:39.191Z","trace_propagation_headers":{"sentry-trace":"8442a37ae37840eea66574f8988ca524-74a157648456428d","baggage":"sentry-trace_id=8442a37ae37840eea66574f8988ca524,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9DPJQ5TY4PJQMZX7WAYFG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:39.201Z","job_size_bytes":89,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-0fb6a52debdebe5a38a62dff: start","job_status":"start","queue_duration_s":100.544912,"scheduling_latency_s":100.544969}2056gitlab # [ 445.197390] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:19.836Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"0fb6a52debdebe5a38a62dff","created_at":"2026-09-18T22:15:39.191Z","trace_propagation_headers":{"sentry-trace":"8442a37ae37840eea66574f8988ca524-74a157648456428d","baggage":"sentry-trace_id=8442a37ae37840eea66574f8988ca524,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9DPJQ5TY4PJQMZX7WAYFG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:39.201Z","job_size_bytes":89,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-0fb6a52debdebe5a38a62dff: done: 0.090207 sec","job_status":"done","queue_duration_s":100.544912,"scheduling_latency_s":100.544969,"redis_calls":11,"redis_duration_s":0.00575,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001307,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003513,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00093,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.060325,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00092346,"duration_s":0.090207,"completed_at":"2026-09-18T22:17:19.836Z","load_balancing_strategy":"primary","db_duration_s":0.011973,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2057gitlab # [ 445.248720] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:19.840Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 76405abae0e94d03d2675e46abc4a7b5dd2e80c1 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"2c014b46fc502e434bbad3fc","created_at":"2026-09-18T22:15:46.986Z","trace_propagation_headers":{"sentry-trace":"6b7e765b4901440abc1c3af372103d0e-2d21f49d006f4574","baggage":"sentry-trace_id=6b7e765b4901440abc1c3af372103d0e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9E1HVTPTGW3WY4BJ0ZDEN","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:46.997Z","job_size_bytes":185,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-2c014b46fc502e434bbad3fc: start","job_status":"start","queue_duration_s":92.84354,"scheduling_latency_s":92.843584}2058gitlab # [ 445.265680] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:19.873Z","message":"changes: \"0000000000000000000000000000000000000000 76405abae0e94d03d2675e46abc4a7b5dd2e80c1 refs/heads/master\\n\""}2059gitlab # [ 445.299996] gitaly[920]: time="2026-09-18T22:17:19.939Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T22:17:29.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:19.925" grpc.time_ms=14.582 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2060gitlab # [ 445.327129] gitaly[920]: time="2026-09-18T22:17:19.967Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-18T22:17:29.027" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:17:19.948" grpc.time_ms=19.461 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2061gitlab # [ 445.428158] gitaly[920]: time="2026-09-18T22:17:20.068Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=3 command.system_time_ms=16 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-18T22:17:30.005" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:20.045" grpc.time_ms=22.695 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2062gitlab # [ 445.513368] gitaly[920]: time="2026-09-18T22:17:20.153Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T22:17:20.152" grpc.time_ms=1.105 pid=920 span.kind=server system=grpc2063gitlab # [ 445.574648] gitaly[920]: time="2026-09-18T22:17:20.215Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3937 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T22:17:20.213" grpc.time_ms=1.373 pid=920 span.kind=server system=grpc2064gitlab # [ 445.603850] gitaly[920]: time="2026-09-18T22:17:20.229Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN diskcache=e9dfaa5e-cf19-43e5-be6a-e53d5f78e990 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-18T22:17:30.052" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:17:20.093" pid=920 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2065gitlab # [ 445.626346] gitaly[920]: time="2026-09-18T22:17:20.230Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=148 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5122 command.oublock=8 command.real_time_ms=129 command.spawn_token_fork_ms=1 command.system_time_ms=92 command.user_time_ms=56 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-18T22:17:30.052" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:17:20.093" grpc.time_ms=136.987 pid=920 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2066gitlab # [ 445.648486] gitaly[920]: time="2026-09-18T22:17:20.263Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-18T22:17:30.222" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:17:20.262" grpc.time_ms=0.626 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2067gitlab # [ 445.662516] gitaly[920]: time="2026-09-18T22:17:20.295Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=859 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=3 command.system_time_ms=16 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-18T22:17:30.229" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:20.270" grpc.time_ms=25.194 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2068gitlab # [ 445.825216] gitaly[920]: time="2026-09-18T22:17:20.465Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=312 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-09-18T22:17:50.051" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:20.452" grpc.time_ms=13.241 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2069gitlab # [ 445.885573] gitaly[920]: time="2026-09-18T22:17:20.526Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-18T22:17:30.004" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:17:20.525" grpc.time_ms=0.616 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2070gitlab # [ 445.916993] gitaly[920]: time="2026-09-18T22:17:20.542Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=315 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-18T22:17:30.009" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-09-18T22:17:20.530" grpc.time_ms=12.092 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2071gitlab # [ 445.951694] gitaly[920]: time="2026-09-18T22:17:20.587Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T22:17:30.048" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:20.568" grpc.time_ms=18.508 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2072gitlab # [ 445.980822] gitaly[920]: time="2026-09-18T22:17:20.615Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T22:17:30.077" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:20.597" grpc.time_ms=18.085 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2073gitlab # [ 446.027676] gitaly[920]: time="2026-09-18T22:17:20.668Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=23 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=3 command.system_time_ms=23 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-18T22:17:50.236" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:20.636" grpc.time_ms=30.969 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2074gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9'2075gitlab # [ 446.151114] nixbot[3643]: INFO: ::ffff:127.0.0.1:59846 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9 HTTP/1.1" 200 OK2076gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9', in 0.07 seconds)2077gitlab # [ 446.825911] gitaly[920]: time="2026-09-18T22:17:21.465Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-18T22:17:31.001" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:21.462" grpc.time_ms=2.794 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2078gitlab # [ 446.872142] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:21.510Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 76405abae0e94d03d2675e46abc4a7b5dd2e80c1 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"2c014b46fc502e434bbad3fc","created_at":"2026-09-18T22:15:46.986Z","trace_propagation_headers":{"sentry-trace":"6b7e765b4901440abc1c3af372103d0e-2d21f49d006f4574","baggage":"sentry-trace_id=6b7e765b4901440abc1c3af372103d0e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9E1HVTPTGW3WY4BJ0ZDEN","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:15:46.997Z","job_size_bytes":185,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-2c014b46fc502e434bbad3fc: done: 1.670399 sec","job_status":"done","queue_duration_s":92.84354,"scheduling_latency_s":92.843584,"gitaly_calls":13,"gitaly_duration_s":0.376867,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.075058,"redis_read_bytes":2103,"redis_write_bytes":21747,"redis_cache_calls":15,"redis_cache_duration_s":0.007009,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.010522,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002658,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7835,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.007517,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.029306,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.018046,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.102,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.37,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.417,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.102,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.117083,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00141754,"exclusive_lock_hold_duration_s":0.04396996,"duration_s":1.670399,"completed_at":"2026-09-18T22:17:21.510Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.180073,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2079gitlab # [ 446.966773] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:21.515Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"e5118b4fabe87ac909cf73b5","created_at":"2026-09-18T22:15:53.459Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-8ade9ec517d04e07","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:53.473Z","job_size_bytes":65,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-e5118b4fabe87ac909cf73b5: start","job_status":"start","queue_duration_s":88.041997,"scheduling_latency_s":88.042057}2080gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9'2081gitlab # [ 447.077568] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:21.716Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"e5118b4fabe87ac909cf73b5","created_at":"2026-09-18T22:15:53.459Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-8ade9ec517d04e07","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:53.473Z","job_size_bytes":65,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-e5118b4fabe87ac909cf73b5: done: 0.201219 sec","job_status":"done","queue_duration_s":88.041997,"scheduling_latency_s":88.042057,"redis_calls":16,"redis_duration_s":0.007523,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.004058,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002575,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.143859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00086934,"duration_s":0.201219,"completed_at":"2026-09-18T22:17:21.716Z","load_balancing_strategy":"primary","db_duration_s":0.042104,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2082gitlab # [ 447.173665] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:21.720Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"099bd728f081f54e3cf982eb","created_at":"2026-09-18T22:15:53.474Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-8ade9ec517d04e07","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:53.484Z","job_size_bytes":65,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-099bd728f081f54e3cf982eb: start","job_status":"start","queue_duration_s":88.235877,"scheduling_latency_s":88.235917}2083gitlab # [ 447.214397] nixbot[3643]: INFO: ::ffff:127.0.0.1:59862 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9 HTTP/1.1" 200 OK2084gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9', in 0.06 seconds)2085gitlab # [ 447.438613] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:22.078Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"099bd728f081f54e3cf982eb","created_at":"2026-09-18T22:15:53.474Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-8ade9ec517d04e07","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:53.484Z","job_size_bytes":65,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-099bd728f081f54e3cf982eb: done: 0.358181 sec","job_status":"done","queue_duration_s":88.235877,"scheduling_latency_s":88.235917,"redis_calls":21,"redis_duration_s":0.008464,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.004043,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002175,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002246,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.052,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.037,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.281581,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00055988,"duration_s":0.358181,"completed_at":"2026-09-18T22:17:22.078Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.062122,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2086gitlab # [ 447.497988] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:22.081Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"d75a5eb931e623a1270a00cf","created_at":"2026-09-18T22:15:53.698Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-8ade9ec517d04e07","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:53.714Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d75a5eb931e623a1270a00cf: start","job_status":"start","queue_duration_s":88.366784,"scheduling_latency_s":88.366819}2087gitlab # [ 447.800365] gitaly[920]: time="2026-09-18T22:17:22.440Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V9E84W14M2VACDVXZN77T8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T22:17:22.439" grpc.time_ms=0.93 pid=920 span.kind=server system=grpc2088gitlab # [ 447.859486] gitaly[920]: time="2026-09-18T22:17:22.498Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V9E84W14M2VACDVXZN77T8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T22:17:22.497" grpc.time_ms=0.909 pid=920 span.kind=server system=grpc2089gitlab # [ 447.931499] gitaly[920]: time="2026-09-18T22:17:22.571Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V9E84W14M2VACDVXZN77T8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T22:17:22.570" grpc.time_ms=0.931 pid=920 span.kind=server system=grpc2090gitlab # [ 447.959286] gitaly[920]: time="2026-09-18T22:17:22.589Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E84W14M2VACDVXZN77T8 diskcache=8f8bcff7-807d-4cb7-bcea-e913ea737a53 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-18T22:17:52.076" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:22.376" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2091gitlab # [ 447.980399] gitaly[920]: time="2026-09-18T22:17:22.589Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=215 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7361 command.oublock=0 command.real_time_ms=204 command.spawn_token_fork_ms=1 command.system_time_ms=139 command.user_time_ms=76 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E84W14M2VACDVXZN77T8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-18T22:17:52.076" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:22.376" grpc.time_ms=212.404 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2092gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9'2093gitlab # [ 448.224469] gitaly[920]: time="2026-09-18T22:17:22.864Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9E84W14M2VACDVXZN77T8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-18T22:17:52.562" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:22.862" grpc.time_ms=1.875 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2094gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9', in 0.06 seconds)2095gitlab # [ 448.279243] nixbot[3643]: INFO: ::ffff:127.0.0.1:59872 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9 HTTP/1.1" 200 OK2096gitlab # [ 448.311611] gitaly[920]: time="2026-09-18T22:17:22.952Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E84W14M2VACDVXZN77T8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T22:17:52.649" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:22.950" grpc.time_ms=1.596 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2097gitlab # [ 448.363711] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:23.002Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"d75a5eb931e623a1270a00cf","created_at":"2026-09-18T22:15:53.698Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-8ade9ec517d04e07","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-18T22:15:53.714Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d75a5eb931e623a1270a00cf: done: 0.920309 sec","job_status":"done","queue_duration_s":88.366784,"scheduling_latency_s":88.366819,"gitaly_calls":3,"gitaly_duration_s":0.229785,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.048734,"redis_read_bytes":455,"redis_write_bytes":28003,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002905,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002505,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.017388,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.007292,"redis_queues_read_bytes":34,"redis_queues_write_bytes":14497,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.009972,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001236,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000926,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003605,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":53,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":53,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.127,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":36,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.044,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.051,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.071,"db_ci_duration_s":0.056,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.531664,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.80501802,"duration_s":0.920309,"completed_at":"2026-09-18T22:17:23.001Z","load_balancing_strategy":"primary","db_duration_s":0.148563,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2098gitlab # [ 448.473280] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:23.005Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","76405abae0e94d03d2675e46abc4a7b5dd2e80c1 a4bc83de92473a228fc3f855cea6097a4c6042c9 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"319d5cce9915f7ca6c337c6e","created_at":"2026-09-18T22:17:18.292Z","trace_propagation_headers":{"sentry-trace":"cf1e6d89abb149bfb291e4fdc7e12c9d-cddd4c61aba641c6","baggage":"sentry-trace_id=cf1e6d89abb149bfb291e4fdc7e12c9d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9GTRNNR62RGJVFPBY7CY9","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:18.303Z","job_size_bytes":185,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-319d5cce9915f7ca6c337c6e: start","job_status":"start","queue_duration_s":4.701918,"scheduling_latency_s":4.701972}2099gitlab # [ 448.497808] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:23.029Z","message":"changes: \"76405abae0e94d03d2675e46abc4a7b5dd2e80c1 a4bc83de92473a228fc3f855cea6097a4c6042c9 refs/heads/master\\n\""}2100gitlab # [ 448.500976] gitaly[920]: time="2026-09-18T22:17:23.081Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9GTRNNR62RGJVFPBY7CY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T22:17:33.021" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:23.061" grpc.time_ms=19.049 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2101gitlab # [ 448.516141] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:23.114Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"98397c1ad9e48a8f4436320d","created_at":"2026-09-18T22:17:23.111Z","trace_propagation_headers":{"sentry-trace":"cf1e6d89abb149bfb291e4fdc7e12c9d-c66a10dc4c194075","baggage":"sentry-trace_id=cf1e6d89abb149bfb291e4fdc7e12c9d,sentry-release=Unknown"},"correlation_id":"01M2V9GTRNNR62RGJVFPBY7CY9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"0a4808155283e09e48454355","job_size_bytes":46,"pid":3513,"job_status":"deduplicated","message":"ProjectCacheWorker JID-98397c1ad9e48a8f4436320d: deduplicated: until executing","deduplication.type":"until executing"}2102gitlab # [ 448.531508] gitaly[920]: time="2026-09-18T22:17:23.107Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=3 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9GTRNNR62RGJVFPBY7CY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-18T22:17:33.050" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:17:23.091" grpc.time_ms=15.852 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2103gitlab # [ 448.544635] gitaly[920]: time="2026-09-18T22:17:23.155Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M2V9GTRNNR62RGJVFPBY7CY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-18T22:17:33.096" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:23.137" grpc.time_ms=18.649 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2104gitlab # [ 448.557535] gitaly[920]: time="2026-09-18T22:17:23.183Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=597 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M2V9GTRNNR62RGJVFPBY7CY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-09-18T22:17:53.066" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:23.166" grpc.time_ms=16.079 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2105gitlab # [ 448.579653] gitaly[920]: time="2026-09-18T22:17:23.220Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=318 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9GTRNNR62RGJVFPBY7CY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-18T22:17:33.007" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-09-18T22:17:23.208" grpc.time_ms=11.716 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2106gitlab # [ 448.615684] gitaly[920]: time="2026-09-18T22:17:23.256Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9GTRNNR62RGJVFPBY7CY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T22:17:33.038" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:23.238" grpc.time_ms=17.015 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2107gitlab # [ 448.816192] gitaly[920]: time="2026-09-18T22:17:23.456Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9GTRNNR62RGJVFPBY7CY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-18T22:17:33.254" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:23.454" grpc.time_ms=1.851 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2108gitlab # [ 448.855832] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:23.494Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","76405abae0e94d03d2675e46abc4a7b5dd2e80c1 a4bc83de92473a228fc3f855cea6097a4c6042c9 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"319d5cce9915f7ca6c337c6e","created_at":"2026-09-18T22:17:18.292Z","trace_propagation_headers":{"sentry-trace":"cf1e6d89abb149bfb291e4fdc7e12c9d-cddd4c61aba641c6","baggage":"sentry-trace_id=cf1e6d89abb149bfb291e4fdc7e12c9d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9GTRNNR62RGJVFPBY7CY9","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:18.303Z","job_size_bytes":185,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-319d5cce9915f7ca6c337c6e: done: 0.488972 sec","job_status":"done","queue_duration_s":4.701918,"scheduling_latency_s":4.701972,"gitaly_calls":7,"gitaly_duration_s":0.133556,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.039344,"redis_read_bytes":501,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.006215,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001761,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.006287,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.011463,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.013618,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.052,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.052,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.048,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.303951,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0013117,"exclusive_lock_hold_duration_s":0.03517096,"duration_s":0.488972,"completed_at":"2026-09-18T22:17:23.494Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.050171,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2109gitlab # [ 448.974488] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:23.497Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"0a4808155283e09e48454355","created_at":"2026-09-18T22:17:19.972Z","trace_propagation_headers":{"sentry-trace":"6b7e765b4901440abc1c3af372103d0e-4999026768194ab4","baggage":"sentry-trace_id=6b7e765b4901440abc1c3af372103d0e,sentry-release=Unknown"},"correlation_id":"01M2V9E1HVTPTGW3WY4BJ0ZDEN","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:20.000Z","job_size_bytes":46,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-0a4808155283e09e48454355: start","job_status":"start","queue_duration_s":3.497204,"scheduling_latency_s":3.497246}2110gitlab # [ 449.000677] gitaly[920]: time="2026-09-18T22:17:23.582Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-09-19T04:17:23.572" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:17:23.572" grpc.time_ms=9.119 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2111gitlab # [ 449.017585] gitaly[920]: time="2026-09-18T22:17:23.615Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=595 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-18T22:17:53.294" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:23.595" grpc.time_ms=19.2 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2112gitlab # [ 449.041755] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:23.681Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"0a4808155283e09e48454355","created_at":"2026-09-18T22:17:19.972Z","trace_propagation_headers":{"sentry-trace":"6b7e765b4901440abc1c3af372103d0e-4999026768194ab4","baggage":"sentry-trace_id=6b7e765b4901440abc1c3af372103d0e,sentry-release=Unknown"},"correlation_id":"01M2V9E1HVTPTGW3WY4BJ0ZDEN","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:20.000Z","job_size_bytes":46,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-0a4808155283e09e48454355: done: 0.183808 sec","job_status":"done","queue_duration_s":3.497204,"scheduling_latency_s":3.497246,"gitaly_calls":2,"gitaly_duration_s":0.036739,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.012122,"redis_read_bytes":69,"redis_write_bytes":4881,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002364,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.00116,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2114,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002758,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.004673,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":748,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001167,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.11112,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00070962,"duration_s":0.183808,"completed_at":"2026-09-18T22:17:23.681Z","load_balancing_strategy":"primary","db_duration_s":0.022633,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2113gitlab # [ 449.101580] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:23.684Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"187fb4993aa7f60bffc266b8","created_at":"2026-09-18T22:17:20.029Z","trace_propagation_headers":{"sentry-trace":"6b7e765b4901440abc1c3af372103d0e-4999026768194ab4","baggage":"sentry-trace_id=6b7e765b4901440abc1c3af372103d0e,sentry-release=Unknown"},"correlation_id":"01M2V9E1HVTPTGW3WY4BJ0ZDEN","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:20.038Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-187fb4993aa7f60bffc266b8: start","job_status":"start","queue_duration_s":3.645826,"scheduling_latency_s":3.645867}2114gitlab # [ 449.126425] gitaly[920]: time="2026-09-18T22:17:23.766Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN diskcache=862b3ff8-a8f5-40cb-bc1e-56dc000204e4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-19T04:17:23.725" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:23.726" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2115gitlab # [ 449.138411] gitaly[920]: time="2026-09-18T22:17:23.767Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=26 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1173 command.oublock=0 command.real_time_ms=48 command.spawn_token_fork_ms=4 command.system_time_ms=26 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-19T04:17:23.725" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:23.726" grpc.time_ms=40.727 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2116gitlab # [ 449.204631] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:23.844Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"187fb4993aa7f60bffc266b8","created_at":"2026-09-18T22:17:20.029Z","trace_propagation_headers":{"sentry-trace":"6b7e765b4901440abc1c3af372103d0e-4999026768194ab4","baggage":"sentry-trace_id=6b7e765b4901440abc1c3af372103d0e,sentry-release=Unknown"},"correlation_id":"01M2V9E1HVTPTGW3WY4BJ0ZDEN","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:20.038Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-187fb4993aa7f60bffc266b8: done: 0.159835 sec","job_status":"done","queue_duration_s":3.645826,"scheduling_latency_s":3.645867,"gitaly_calls":1,"gitaly_duration_s":0.045072,"redis_calls":15,"redis_duration_s":0.006024,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000727,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002266,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001093,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001938,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.02,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.039,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.075814,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.11491304000000001,"duration_s":0.159835,"completed_at":"2026-09-18T22:17:23.844Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02942,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2117gitlab # [ 449.252158] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:23.847Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"3ef58ddfc0f1a886fc7ce7b9","created_at":"2026-09-18T22:17:20.253Z","trace_propagation_headers":{"sentry-trace":"6b7e765b4901440abc1c3af372103d0e-4999026768194ab4","baggage":"sentry-trace_id=6b7e765b4901440abc1c3af372103d0e,sentry-release=Unknown"},"correlation_id":"01M2V9E1HVTPTGW3WY4BJ0ZDEN","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:20.257Z","job_size_bytes":23,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-3ef58ddfc0f1a886fc7ce7b9: start","job_status":"start","queue_duration_s":3.589509,"scheduling_latency_s":3.589546}2118gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9'2119gitlab # [ 449.275416] gitaly[920]: time="2026-09-18T22:17:23.916Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=594 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=11 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-18T22:17:53.596" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:23.896" grpc.time_ms=18.916 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2120gitlab # [ 449.293981] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:23.933Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"3ef58ddfc0f1a886fc7ce7b9","created_at":"2026-09-18T22:17:20.253Z","trace_propagation_headers":{"sentry-trace":"6b7e765b4901440abc1c3af372103d0e-4999026768194ab4","baggage":"sentry-trace_id=6b7e765b4901440abc1c3af372103d0e,sentry-release=Unknown"},"correlation_id":"01M2V9E1HVTPTGW3WY4BJ0ZDEN","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:20.257Z","job_size_bytes":23,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-3ef58ddfc0f1a886fc7ce7b9: done: 0.086585 sec","job_status":"done","queue_duration_s":3.589509,"scheduling_latency_s":3.589546,"gitaly_calls":1,"gitaly_duration_s":0.022946,"redis_calls":16,"redis_duration_s":0.006427,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000655,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001872,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002738,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001162,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049164,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.086585,"completed_at":"2026-09-18T22:17:23.933Z","load_balancing_strategy":"primary","db_duration_s":0.005704,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2121gitlab # [ 449.338197] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:23.936Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"8cd376360085f103e3ac8029","created_at":"2026-09-18T22:17:21.164Z","trace_propagation_headers":{"sentry-trace":"6b7e765b4901440abc1c3af372103d0e-4999026768194ab4","baggage":"sentry-trace_id=6b7e765b4901440abc1c3af372103d0e,sentry-release=Unknown"},"correlation_id":"01M2V9E1HVTPTGW3WY4BJ0ZDEN","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0aeed1e8c609a56aedde3a73ae82763e8506842e04176c136be68dd95290934d","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:21.177Z","job_size_bytes":467,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-8cd376360085f103e3ac8029: start","job_status":"start","queue_duration_s":2.75873,"scheduling_latency_s":2.758765}2122gitlab # [ 449.355237] gitaly[920]: time="2026-09-18T22:17:23.982Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T22:17:53.680" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:23.981" grpc.time_ms=1.163 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2123gitlab # [ 449.367650] gitaly[920]: time="2026-09-18T22:17:24.004Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-18T22:17:33.006" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:23.986" grpc.time_ms=17.375 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2124gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9', in 0.10 seconds)2125gitlab # [ 449.381422] nixbot[3643]: INFO: ::ffff:127.0.0.1:59888 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9 HTTP/1.1" 200 OK2126gitlab # [ 449.515248] gitaly[920]: time="2026-09-18T22:17:24.155Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-18T22:17:54.053" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:24.153" grpc.time_ms=1.625 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2127gitlab # [ 449.553124] gitaly[920]: time="2026-09-18T22:17:24.167Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=26 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-18T22:17:54.064" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:24.164" grpc.time_ms=3.409 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2128gitlab # [ 449.719172] gitaly[920]: time="2026-09-18T22:17:24.359Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T22:17:34.140" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:24.341" grpc.time_ms=18.268 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2129gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9'2130gitlab # [ 450.391236] gitaly[920]: time="2026-09-18T22:17:25.031Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=883 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=3 command.system_time_ms=11 command.user_time_ms=10 component=gitaly.StreamServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-18T22:17:55.100" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:25.001" grpc.time_ms=29.472 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2131gitlab # [ 450.427218] gitaly[920]: time="2026-09-18T22:17:25.067Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9E1HVTPTGW3WY4BJ0ZDEN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-18T22:17:55.139" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:25.041" grpc.time_ms=26.573 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2132gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9', in 0.06 seconds)2133gitlab # [ 450.444540] nixbot[3643]: INFO: ::ffff:127.0.0.1:59898 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9 HTTP/1.1" 200 OK2134gitlab # [ 450.500594] sidekiq-cluster[3513]: {"severity":"WARN","time":"2026-09-18T22:17:25.139Z","class":"CreatePipelineWorker","correlation_id":"01M2V9E1HVTPTGW3WY4BJ0ZDEN","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"76405abae0e94d03d2675e46abc4a7b5dd2e80c1","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"76405abae0e94d03d2675e46abc4a7b5dd2e80c1","ref":"refs/heads/master"},"retry":0}2135gitlab # [ 450.518354] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:25.155Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"8cd376360085f103e3ac8029","created_at":"2026-09-18T22:17:21.164Z","trace_propagation_headers":{"sentry-trace":"6b7e765b4901440abc1c3af372103d0e-4999026768194ab4","baggage":"sentry-trace_id=6b7e765b4901440abc1c3af372103d0e,sentry-release=Unknown"},"correlation_id":"01M2V9E1HVTPTGW3WY4BJ0ZDEN","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0aeed1e8c609a56aedde3a73ae82763e8506842e04176c136be68dd95290934d","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:21.177Z","job_size_bytes":467,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-8cd376360085f103e3ac8029: done: 1.218694 sec","job_status":"done","queue_duration_s":2.75873,"scheduling_latency_s":2.758765,"gitaly_calls":7,"gitaly_duration_s":0.131133,"redis_calls":51,"redis_duration_s":0.017225,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.002461,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.006932,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001931,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.004073,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001828,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.054,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.047,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.999979,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00078066,"duration_s":1.218694,"completed_at":"2026-09-18T22:17:25.155Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.096195,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2136gitlab # [ 450.588089] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:25.159Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"32e1be3f-b60a-434c-ae28-ea3e0581865d\"}"],"class":"WebHookWorker","jid":"2bfee2a46db1f2ed9c10aa12","created_at":"2026-09-18T22:17:21.415Z","trace_propagation_headers":{"sentry-trace":"6b7e765b4901440abc1c3af372103d0e-4999026768194ab4","baggage":"sentry-trace_id=6b7e765b4901440abc1c3af372103d0e,sentry-release=Unknown"},"correlation_id":"01M2V9E1HVTPTGW3WY4BJ0ZDEN","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7f978adaaa07afdb8fd4e1b7d41d75b5c955d3682ce5fc0730b42939cec23853","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:21.423Z","job_size_bytes":1751,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-2bfee2a46db1f2ed9c10aa12: start","job_status":"start","queue_duration_s":3.735225,"scheduling_latency_s":3.735266}2137gitlab # [ 450.748718] nixbot[3643]: INFO: ::ffff:127.0.0.1:59912 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2138gitlab # [ 450.792430] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:25.431Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"32e1be3f-b60a-434c-ae28-ea3e0581865d\"}"],"class":"WebHookWorker","jid":"2bfee2a46db1f2ed9c10aa12","created_at":"2026-09-18T22:17:21.415Z","trace_propagation_headers":{"sentry-trace":"6b7e765b4901440abc1c3af372103d0e-4999026768194ab4","baggage":"sentry-trace_id=6b7e765b4901440abc1c3af372103d0e,sentry-release=Unknown"},"correlation_id":"01M2V9E1HVTPTGW3WY4BJ0ZDEN","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7f978adaaa07afdb8fd4e1b7d41d75b5c955d3682ce5fc0730b42939cec23853","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:21.423Z","job_size_bytes":1751,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-2bfee2a46db1f2ed9c10aa12: done: 0.272555 sec","job_status":"done","queue_duration_s":3.735225,"scheduling_latency_s":3.735266,"redis_calls":19,"redis_duration_s":0.006825,"redis_read_bytes":32,"redis_write_bytes":5366,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001873,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000696,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002771,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001485,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.10589706000001797,"cpu_s":0.139797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00065808,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.272555,"completed_at":"2026-09-18T22:17:25.431Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006012,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2139gitlab # [ 450.890881] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:25.435Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"a41444e62f7fa4f2273aab0c","created_at":"2026-09-18T22:17:22.343Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-c7d2af24505c4c4c","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:22.355Z","job_size_bytes":23,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-a41444e62f7fa4f2273aab0c: start","job_status":"start","queue_duration_s":3.079977,"scheduling_latency_s":3.080017}2140gitlab # [ 450.954998] gitaly[920]: time="2026-09-18T22:17:25.594Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=3 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9H2P754TPKC3APN76XEB6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:17:25.576" grpc.time_ms=18.482 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2141gitlab # [ 450.982823] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:25 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1472142gitlab # [ 450.986452] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:25.594Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"a41444e62f7fa4f2273aab0c","created_at":"2026-09-18T22:17:22.343Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-c7d2af24505c4c4c","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:22.355Z","job_size_bytes":23,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-a41444e62f7fa4f2273aab0c: done: 0.159149 sec","job_status":"done","queue_duration_s":3.079977,"scheduling_latency_s":3.080017,"redis_calls":10,"redis_duration_s":0.005945,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000597,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004463,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000885,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.116007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004911,"duration_s":0.159149,"completed_at":"2026-09-18T22:17:25.594Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031414,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2143gitlab # [ 451.039502] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:25.596Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"ce5409cf6f4335b1d477c195","created_at":"2026-09-18T22:17:22.601Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-c7d2af24505c4c4c","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:22.615Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-ce5409cf6f4335b1d477c195: start","job_status":"start","queue_duration_s":2.981001,"scheduling_latency_s":2.981031}2144gitlab # [ 451.055934] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:25.664Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"ce5409cf6f4335b1d477c195","created_at":"2026-09-18T22:17:22.601Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-c7d2af24505c4c4c","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:22.615Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-ce5409cf6f4335b1d477c195: done: 0.067973 sec","job_status":"done","queue_duration_s":2.981001,"scheduling_latency_s":2.981031,"redis_calls":10,"redis_duration_s":0.004062,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000809,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002457,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000796,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00073312,"duration_s":0.067973,"completed_at":"2026-09-18T22:17:25.664Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010584,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2145gitlab # [ 451.100685] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:25.667Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"9fbaed6936a1c0873c6b3737","created_at":"2026-09-18T22:17:22.654Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-c7d2af24505c4c4c","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:22.671Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-9fbaed6936a1c0873c6b3737: start","job_status":"start","queue_duration_s":2.996255,"scheduling_latency_s":2.996289}2146gitlab # [ 451.116056] gitaly[920]: time="2026-09-18T22:17:25.714Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H2V0G7EQ82593TJ7VN6S grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:17:25.693" pid=920 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2147gitlab # [ 451.125899] gitlab-workhorse[822]: time="2026-09-18T22:17:25Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672148gitlab # [ 451.127657] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:25 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1152149gitlab # [ 451.129579] gitaly[920]: time="2026-09-18T22:17:25.715Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=4 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H2V0G7EQ82593TJ7VN6S grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:17:25.693" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2150gitlab # [ 451.142473] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:25.768Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"9fbaed6936a1c0873c6b3737","created_at":"2026-09-18T22:17:22.654Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-c7d2af24505c4c4c","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:22.671Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-9fbaed6936a1c0873c6b3737: done: 0.101085 sec","job_status":"done","queue_duration_s":2.996255,"scheduling_latency_s":2.996289,"redis_calls":10,"redis_duration_s":0.004863,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000881,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002998,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000984,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.073525,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00087972,"duration_s":0.101085,"completed_at":"2026-09-18T22:17:25.768Z","load_balancing_strategy":"primary","db_duration_s":0.013343,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2151gitlab # [ 451.184794] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:25.772Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"475c1ff30ac33f5320d07387","created_at":"2026-09-18T22:17:22.705Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-c7d2af24505c4c4c","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:22.718Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-475c1ff30ac33f5320d07387: start","job_status":"start","queue_duration_s":3.053246,"scheduling_latency_s":3.053282}2152gitlab # [ 451.199945] gitaly[920]: time="2026-09-18T22:17:25.716Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=4 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H2V0G7EQ82593TJ7VN6S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:17:25.693" grpc.time_ms=22.266 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2153gitlab # [ 451.215099] gitlab-workhorse[822]: time="2026-09-18T22:17:25Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3372154gitlab # [ 451.216947] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:25 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 1202155gitlab # [ 451.218751] gitaly[920]: time="2026-09-18T22:17:25.838Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H2YQNDB9TYB55W9NANFK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:17:25.812" pid=920 remote_ip="2001:db8:1::1" request_sha=ee085c25873cadd93d5b893f107e5c29505dcefa response_bytes=337 span.kind=server system=grpc2156gitlab # [ 451.228528] gitaly[920]: time="2026-09-18T22:17:25.838Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1128 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=18 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H2YQNDB9TYB55W9NANFK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:17:25.812" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2157gitlab # [ 451.241851] gitaly[920]: time="2026-09-18T22:17:25.839Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1128 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=18 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H2YQNDB9TYB55W9NANFK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:17:25.812" grpc.time_ms=27.022 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2158gitlab # [ 451.256519] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:25.873Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"475c1ff30ac33f5320d07387","created_at":"2026-09-18T22:17:22.705Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-c7d2af24505c4c4c","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:22.718Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-475c1ff30ac33f5320d07387: done: 0.101097 sec","job_status":"done","queue_duration_s":3.053246,"scheduling_latency_s":3.053282,"redis_calls":13,"redis_duration_s":0.008945,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000639,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003343,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00304,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001923,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.066956,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00100354,"duration_s":0.101097,"completed_at":"2026-09-18T22:17:25.873Z","load_balancing_strategy":"primary","db_duration_s":0.013117,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2159gitlab # [ 451.301497] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:25.877Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"0e9dd53574ce49e97a466899","created_at":"2026-09-18T22:17:22.720Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-c7d2af24505c4c4c","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:22.731Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-0e9dd53574ce49e97a466899: start","job_status":"start","queue_duration_s":3.145486,"scheduling_latency_s":3.145537}2160gitlab # [ 451.317821] nixbot[3643]: {"ts": "2026-09-18T22:17:25.886Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2161gitlab # [ 451.320286] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:25.958Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"0e9dd53574ce49e97a466899","created_at":"2026-09-18T22:17:22.720Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-c7d2af24505c4c4c","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:22.731Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-0e9dd53574ce49e97a466899: done: 0.081126 sec","job_status":"done","queue_duration_s":3.145486,"scheduling_latency_s":3.145537,"redis_calls":10,"redis_duration_s":0.004089000000000001,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000695,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00255,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000844,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056526,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0007194,"duration_s":0.081126,"completed_at":"2026-09-18T22:17:25.958Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00991,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2162gitlab # [ 451.363428] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:25.960Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"6678d82e6a2627c216d098f1","created_at":"2026-09-18T22:17:22.733Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-c7d2af24505c4c4c","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:22.742Z","job_size_bytes":19,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-6678d82e6a2627c216d098f1: start","job_status":"start","queue_duration_s":3.218427,"scheduling_latency_s":3.218478}2163gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9'2164gitlab # [ 451.393169] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:26.033Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"6678d82e6a2627c216d098f1","created_at":"2026-09-18T22:17:22.733Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-c7d2af24505c4c4c","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:22.742Z","job_size_bytes":19,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-6678d82e6a2627c216d098f1: done: 0.072188 sec","job_status":"done","queue_duration_s":3.218427,"scheduling_latency_s":3.218478,"redis_calls":11,"redis_duration_s":0.012468,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000622,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.011196,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00065,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0011875,"duration_s":0.072188,"completed_at":"2026-09-18T22:17:26.032Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008428,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2165gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9', in 0.06 seconds)2166gitlab # [ 451.483932] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:26.035Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"4990aeb101a9c07fc96c566b","created_at":"2026-09-18T22:17:22.749Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-c7d2af24505c4c4c","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:22.757Z","job_size_bytes":66,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-4990aeb101a9c07fc96c566b: start","job_status":"start","queue_duration_s":3.277651,"scheduling_latency_s":3.27768}2167gitlab # [ 451.509833] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:26.089Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"4990aeb101a9c07fc96c566b","created_at":"2026-09-18T22:17:22.749Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-c7d2af24505c4c4c","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:22.757Z","job_size_bytes":66,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-4990aeb101a9c07fc96c566b: done: 0.054289 sec","job_status":"done","queue_duration_s":3.277651,"scheduling_latency_s":3.27768,"redis_calls":10,"redis_duration_s":0.002854,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000582,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001644,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000628,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035709,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004334,"duration_s":0.054289,"completed_at":"2026-09-18T22:17:26.089Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009478,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2168gitlab # [ 451.569302] gitaly[920]: time="2026-09-18T22:17:26.033Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H34H4HPM0T47TKM1WC7W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T22:17:56.031" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:26.032" grpc.time_ms=1.133 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2169gitlab # [ 451.583068] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:26 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/76405abae0e94d03d2675e46abc4a7b5dd2e80c1 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 2922170gitlab # [ 451.585933] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:26.091Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"17016dc8995abcfb4bbe799b","created_at":"2026-09-18T22:17:22.759Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-c7d2af24505c4c4c","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:22.767Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-17016dc8995abcfb4bbe799b: start","job_status":"start","queue_duration_s":3.324256,"scheduling_latency_s":3.324282}2171gitlab # [ 451.602618] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:26.172Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"17016dc8995abcfb4bbe799b","created_at":"2026-09-18T22:17:22.759Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-c7d2af24505c4c4c","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:22.767Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-17016dc8995abcfb4bbe799b: done: 0.080695 sec","job_status":"done","queue_duration_s":3.324256,"scheduling_latency_s":3.324282,"redis_calls":10,"redis_duration_s":0.004403,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000563,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003232,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000608,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05338,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00066344,"duration_s":0.080695,"completed_at":"2026-09-18T22:17:26.172Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013962,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2172gitlab # [ 451.646625] nixbot[3643]: INFO: ::ffff:127.0.0.1:43106 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9 HTTP/1.1" 200 OK2173gitlab # [ 451.648725] nixbot[3643]: {"ts": "2026-09-18T22:17:26.199Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/76405abae0e94d03d2675e46abc4a7b5dd2e80c1 \"HTTP/1.1 201 Created\""}2174gitlab # [ 451.651417] gitaly[920]: time="2026-09-18T22:17:26.130Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M2V9H34H4HPM0T47TKM1WC7W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T22:17:36.098" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:26.119" grpc.time_ms=10.525 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2175gitlab # [ 451.664875] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:26.175Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"ca5174fd74834c4d1aeac9cf","created_at":"2026-09-18T22:17:22.780Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-c7d2af24505c4c4c","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:22.788Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-ca5174fd74834c4d1aeac9cf: start","job_status":"start","queue_duration_s":3.386615,"scheduling_latency_s":3.386651}2176gitlab # [ 451.680900] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:26.247Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"ca5174fd74834c4d1aeac9cf","created_at":"2026-09-18T22:17:22.780Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-c7d2af24505c4c4c","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:22.788Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-ca5174fd74834c4d1aeac9cf: done: 0.072132 sec","job_status":"done","queue_duration_s":3.386615,"scheduling_latency_s":3.386651,"redis_calls":10,"redis_duration_s":0.003992,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000575,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002665,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000752,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044824,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00118822,"duration_s":0.072132,"completed_at":"2026-09-18T22:17:26.247Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015275,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2177gitlab # [ 451.725735] gitaly[920]: time="2026-09-18T22:17:26.276Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H3DWDVDX4F1AQM43A1A7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T22:17:56.274" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:26.275" grpc.time_ms=1.067 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2178gitlab # [ 451.738263] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:26.250Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"f603c94896648f9919a3c431","created_at":"2026-09-18T22:17:22.789Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-c7d2af24505c4c4c","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:22.796Z","job_size_bytes":6,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-f603c94896648f9919a3c431: start","job_status":"start","queue_duration_s":3.453887,"scheduling_latency_s":3.453921}2179gitlab # [ 451.754116] gitaly[920]: time="2026-09-18T22:17:26.339Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M2V9H3DWDVDX4F1AQM43A1A7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T22:17:36.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:26.329" grpc.time_ms=9.659 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2180gitlab # [ 451.780319] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:26 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/76405abae0e94d03d2675e46abc4a7b5dd2e80c1 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2162181gitlab # [ 451.782777] nixbot[3643]: {"ts": "2026-09-18T22:17:26.422Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/76405abae0e94d03d2675e46abc4a7b5dd2e80c1 \"HTTP/1.1 201 Created\""}2182gitlab # [ 451.827772] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:26.467Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"f603c94896648f9919a3c431","created_at":"2026-09-18T22:17:22.789Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-c7d2af24505c4c4c","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:22.796Z","job_size_bytes":6,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-f603c94896648f9919a3c431: done: 0.217166 sec","job_status":"done","queue_duration_s":3.453887,"scheduling_latency_s":3.453921,"redis_calls":10,"redis_duration_s":0.003882,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000897,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002246,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000739,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.197481,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00062722,"duration_s":0.217166,"completed_at":"2026-09-18T22:17:26.467Z","load_balancing_strategy":"primary","db_duration_s":0.003808,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2183gitlab # [ 451.884150] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:26.470Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"de672bb956335325fb4e33e6","created_at":"2026-09-18T22:17:22.797Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-c7d2af24505c4c4c","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:22.806Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-de672bb956335325fb4e33e6: start","job_status":"start","queue_duration_s":3.663629,"scheduling_latency_s":3.663678}2184gitlab # [ 451.899760] gitaly[920]: time="2026-09-18T22:17:26.517Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H3N11T2ZKW4429YZCHF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T22:17:56.515" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:26.516" grpc.time_ms=1.101 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2185gitlab # [ 451.912474] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:26.550Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"de672bb956335325fb4e33e6","created_at":"2026-09-18T22:17:22.797Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-c7d2af24505c4c4c","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:22.806Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-de672bb956335325fb4e33e6: done: 0.07972 sec","job_status":"done","queue_duration_s":3.663629,"scheduling_latency_s":3.663678,"redis_calls":10,"redis_duration_s":0.006098,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00071,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003534,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001854,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00065974,"duration_s":0.07972,"completed_at":"2026-09-18T22:17:26.550Z","load_balancing_strategy":"primary","db_duration_s":0.013837,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2186gitlab # [ 451.956117] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:26.555Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"5ede4201704a28c116f7d700","created_at":"2026-09-18T22:17:22.822Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-c7d2af24505c4c4c","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:22.834Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-5ede4201704a28c116f7d700: start","job_status":"start","queue_duration_s":3.721395,"scheduling_latency_s":3.721425}2187gitlab # [ 451.971644] gitaly[920]: time="2026-09-18T22:17:26.609Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9H3N11T2ZKW4429YZCHF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T22:17:36.044" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:26.585" grpc.time_ms=23.701 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2188gitlab # [ 452.022323] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:26.662Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"5ede4201704a28c116f7d700","created_at":"2026-09-18T22:17:22.822Z","trace_propagation_headers":{"sentry-trace":"a2f77d4035534633ba7318710b6e4e89-c7d2af24505c4c4c","baggage":"sentry-trace_id=a2f77d4035534633ba7318710b6e4e89,sentry-release=Unknown"},"correlation_id":"01M2V9E84W14M2VACDVXZN77T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:22.834Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-5ede4201704a28c116f7d700: done: 0.106613 sec","job_status":"done","queue_duration_s":3.721395,"scheduling_latency_s":3.721425,"redis_calls":14,"redis_duration_s":0.0047090000000000005,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00062,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002409,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00168,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065809,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00092286,"duration_s":0.106613,"completed_at":"2026-09-18T22:17:26.662Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026659,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2189gitlab # [ 452.066032] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:26.665Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"86a10009c641c09d77814448","created_at":"2026-09-18T22:17:23.125Z","trace_propagation_headers":{"sentry-trace":"cf1e6d89abb149bfb291e4fdc7e12c9d-c66a10dc4c194075","baggage":"sentry-trace_id=cf1e6d89abb149bfb291e4fdc7e12c9d,sentry-release=Unknown"},"correlation_id":"01M2V9GTRNNR62RGJVFPBY7CY9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"187fb4993aa7f60bffc266b8","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:23.130Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-86a10009c641c09d77814448: start","job_status":"start","queue_duration_s":3.534516,"scheduling_latency_s":3.534558}2190gitlab # [ 452.083377] nixbot[3643]: {"ts": "2026-09-18T22:17:26.715Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/76405abae0e94d03d2675e46abc4a7b5dd2e80c1 \"HTTP/1.1 201 Created\""}2191gitlab # [ 452.086347] gitaly[920]: time="2026-09-18T22:17:26.721Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9GTRNNR62RGJVFPBY7CY9 diskcache=3b29d73d-12d6-4959-a215-b494e5406116 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-19T04:17:26.703" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:26.705" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2192gitlab # [ 452.096437] gitaly[920]: time="2026-09-18T22:17:26.722Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=290 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9GTRNNR62RGJVFPBY7CY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-19T04:17:26.703" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:26.705" grpc.time_ms=16.647 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2193gitlab # [ 452.109756] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:26 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/76405abae0e94d03d2675e46abc4a7b5dd2e80c1 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2802194gitlab # [ 452.122934] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:26.762Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"86a10009c641c09d77814448","created_at":"2026-09-18T22:17:23.125Z","trace_propagation_headers":{"sentry-trace":"cf1e6d89abb149bfb291e4fdc7e12c9d-c66a10dc4c194075","baggage":"sentry-trace_id=cf1e6d89abb149bfb291e4fdc7e12c9d,sentry-release=Unknown"},"correlation_id":"01M2V9GTRNNR62RGJVFPBY7CY9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"187fb4993aa7f60bffc266b8","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:23.130Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-86a10009c641c09d77814448: done: 0.0977 sec","job_status":"done","queue_duration_s":3.534516,"scheduling_latency_s":3.534558,"gitaly_calls":1,"gitaly_duration_s":0.022505,"redis_calls":12,"redis_duration_s":0.005651,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002177,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001474,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.014,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.014,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055829,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.05624382,"duration_s":0.0977,"completed_at":"2026-09-18T22:17:26.762Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013284,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2195gitlab # [ 452.167799] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:26.766Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"9d2c72144eaa0216f711c317","created_at":"2026-09-18T22:17:23.377Z","trace_propagation_headers":{"sentry-trace":"cf1e6d89abb149bfb291e4fdc7e12c9d-c66a10dc4c194075","baggage":"sentry-trace_id=cf1e6d89abb149bfb291e4fdc7e12c9d,sentry-release=Unknown"},"correlation_id":"01M2V9GTRNNR62RGJVFPBY7CY9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:24f8bbed8e8677fbaede78c79608aeb722593b3d755e3cc2828867219ecdc1f2","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:23.383Z","job_size_bytes":467,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-9d2c72144eaa0216f711c317: start","job_status":"start","queue_duration_s":3.383027,"scheduling_latency_s":3.383069}2196gitlab # [ 452.197415] gitaly[920]: time="2026-09-18T22:17:26.837Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9GTRNNR62RGJVFPBY7CY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T22:17:56.935" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:26.835" grpc.time_ms=1.733 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2197gitlab # [ 452.216974] gitaly[920]: time="2026-09-18T22:17:26.857Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9GTRNNR62RGJVFPBY7CY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-18T22:17:36.002" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:26.844" grpc.time_ms=13.042 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2198gitlab # [ 452.254652] gitaly[920]: time="2026-09-18T22:17:26.895Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M2V9H3ZQARV78G43QDNZTQSK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:17:26.877" grpc.time_ms=17.336 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2199gitlab # [ 452.270689] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:26 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1202200gitlab # [ 452.302352] gitaly[920]: time="2026-09-18T22:17:26.942Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9GTRNNR62RGJVFPBY7CY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-18T22:17:56.040" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:26.940" grpc.time_ms=2.009 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2201gitlab # [ 452.323016] gitaly[920]: time="2026-09-18T22:17:26.954Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=212 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M2V9GTRNNR62RGJVFPBY7CY9 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-18T22:17:56.048" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:26.948" grpc.time_ms=5.62 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2202gitlab # [ 452.386565] gitaly[920]: time="2026-09-18T22:17:27.027Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9GTRNNR62RGJVFPBY7CY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T22:17:37.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:27.011" grpc.time_ms=15.781 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2203gitlab # [ 452.402239] gitaly[920]: time="2026-09-18T22:17:27.035Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H43J6MAFS6H8H4B07EVR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:17:27.015" pid=920 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2204gitlab # [ 452.413292] gitlab-workhorse[822]: time="2026-09-18T22:17:27Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672205gitlab # [ 452.415175] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:27 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1382206gitlab # [ 452.417187] gitaly[920]: time="2026-09-18T22:17:27.035Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H43J6MAFS6H8H4B07EVR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:17:27.015" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2207gitlab # [ 452.430564] gitaly[920]: time="2026-09-18T22:17:27.036Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H43J6MAFS6H8H4B07EVR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:17:27.015" grpc.time_ms=20.653 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2208gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9'2209gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9', in 0.09 seconds)2210gitlab # [ 452.583035] nixbot[3643]: INFO: ::ffff:127.0.0.1:43116 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9 HTTP/1.1" 200 OK2211gitlab # [ 452.984784] gitaly[920]: time="2026-09-18T22:17:27.624Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=24 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=27 command.spawn_token_fork_ms=3 command.system_time_ms=20 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M2V9GTRNNR62RGJVFPBY7CY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-18T22:17:57.690" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:27.591" grpc.time_ms=32.66 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2212gitlab # [ 453.024727] gitaly[920]: time="2026-09-18T22:17:27.658Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M2V9GTRNNR62RGJVFPBY7CY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-18T22:17:57.731" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:27.631" grpc.time_ms=26.521 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2213gitlab # [ 453.048289] sidekiq-cluster[3513]: {"severity":"WARN","time":"2026-09-18T22:17:27.686Z","class":"CreatePipelineWorker","correlation_id":"01M2V9GTRNNR62RGJVFPBY7CY9","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"76405abae0e94d03d2675e46abc4a7b5dd2e80c1","after":"a4bc83de92473a228fc3f855cea6097a4c6042c9","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"a4bc83de92473a228fc3f855cea6097a4c6042c9","ref":"refs/heads/master"},"retry":0}2214gitlab # [ 453.058445] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:27.697Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"9d2c72144eaa0216f711c317","created_at":"2026-09-18T22:17:23.377Z","trace_propagation_headers":{"sentry-trace":"cf1e6d89abb149bfb291e4fdc7e12c9d-c66a10dc4c194075","baggage":"sentry-trace_id=cf1e6d89abb149bfb291e4fdc7e12c9d,sentry-release=Unknown"},"correlation_id":"01M2V9GTRNNR62RGJVFPBY7CY9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:24f8bbed8e8677fbaede78c79608aeb722593b3d755e3cc2828867219ecdc1f2","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:23.383Z","job_size_bytes":467,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-9d2c72144eaa0216f711c317: done: 0.931637 sec","job_status":"done","queue_duration_s":3.383027,"scheduling_latency_s":3.383069,"gitaly_calls":7,"gitaly_duration_s":0.132166,"redis_calls":33,"redis_duration_s":0.014972,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.00113,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004064,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003894,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.005884,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.037,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.765887,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.931637,"completed_at":"2026-09-18T22:17:27.697Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.042114,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2215gitlab # [ 453.117709] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:27.701Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"1fb82c83-4e3d-44ac-b8b9-90ad00f60b63\"}"],"class":"WebHookWorker","jid":"2bd5eb4ab0a4a19cd1db91b9","created_at":"2026-09-18T22:17:23.420Z","trace_propagation_headers":{"sentry-trace":"cf1e6d89abb149bfb291e4fdc7e12c9d-c66a10dc4c194075","baggage":"sentry-trace_id=cf1e6d89abb149bfb291e4fdc7e12c9d,sentry-release=Unknown"},"correlation_id":"01M2V9GTRNNR62RGJVFPBY7CY9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d2abbb584177d34b04140e82b34d305227a22114633f4f1dd72d6fd8b78b34be","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:23.426Z","job_size_bytes":1749,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-2bd5eb4ab0a4a19cd1db91b9: start","job_status":"start","queue_duration_s":4.274657,"scheduling_latency_s":4.274705}2216gitlab # [ 453.138615] nixbot[3643]: INFO: ::ffff:127.0.0.1:43126 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2217gitlab # [ 453.140108] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:27.771Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"1fb82c83-4e3d-44ac-b8b9-90ad00f60b63\"}"],"class":"WebHookWorker","jid":"2bd5eb4ab0a4a19cd1db91b9","created_at":"2026-09-18T22:17:23.420Z","trace_propagation_headers":{"sentry-trace":"cf1e6d89abb149bfb291e4fdc7e12c9d-c66a10dc4c194075","baggage":"sentry-trace_id=cf1e6d89abb149bfb291e4fdc7e12c9d,sentry-release=Unknown"},"correlation_id":"01M2V9GTRNNR62RGJVFPBY7CY9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d2abbb584177d34b04140e82b34d305227a22114633f4f1dd72d6fd8b78b34be","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:23.426Z","job_size_bytes":1749,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-2bd5eb4ab0a4a19cd1db91b9: done: 0.070654 sec","job_status":"done","queue_duration_s":4.274657,"scheduling_latency_s":4.274705,"redis_calls":14,"redis_duration_s":0.005166,"redis_read_bytes":25,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000819,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002921,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001426,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.011497259999998732,"cpu_s":0.044523,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.070654,"completed_at":"2026-09-18T22:17:27.771Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004246,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2218gitlab # [ 453.190070] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:27.774Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"2b1dda5d5cbfa9028f9df4fc","created_at":"2026-09-18T22:17:23.636Z","trace_propagation_headers":{"sentry-trace":"6b7e765b4901440abc1c3af372103d0e-b70b2fdbfee84b5d","baggage":"sentry-trace_id=6b7e765b4901440abc1c3af372103d0e,sentry-release=Unknown"},"correlation_id":"01M2V9E1HVTPTGW3WY4BJ0ZDEN","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:23.648Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-2b1dda5d5cbfa9028f9df4fc: start","job_status":"start","queue_duration_s":4.12572,"scheduling_latency_s":4.125756}2219gitlab # [ 453.234356] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:27.874Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"2b1dda5d5cbfa9028f9df4fc","created_at":"2026-09-18T22:17:23.636Z","trace_propagation_headers":{"sentry-trace":"6b7e765b4901440abc1c3af372103d0e-b70b2fdbfee84b5d","baggage":"sentry-trace_id=6b7e765b4901440abc1c3af372103d0e,sentry-release=Unknown"},"correlation_id":"01M2V9E1HVTPTGW3WY4BJ0ZDEN","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:23.648Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-2b1dda5d5cbfa9028f9df4fc: done: 0.099561 sec","job_status":"done","queue_duration_s":4.12572,"scheduling_latency_s":4.125756,"redis_calls":19,"redis_duration_s":0.010693,"redis_read_bytes":21,"redis_write_bytes":4291,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.003575,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.001276,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2262,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.003793,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.002049,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.068939,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01973664,"duration_s":0.099561,"completed_at":"2026-09-18T22:17:27.874Z","load_balancing_strategy":"primary","db_duration_s":0.015779,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2220gitlab # [ 453.286339] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:27.877Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","2bfee2a46db1f2ed9c10aa12"],"class":"WebHooks::LogExecutionWorker","jid":"33bc32083b3df6335141671f","created_at":"2026-09-18T22:17:25.395Z","trace_propagation_headers":{"sentry-trace":"6b7e765b4901440abc1c3af372103d0e-0697c1014f19445e","baggage":"sentry-trace_id=6b7e765b4901440abc1c3af372103d0e,sentry-release=Unknown"},"correlation_id":"01M2V9E1HVTPTGW3WY4BJ0ZDEN","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2e919669f7cfde647139fd084a77da164bec2ab45f9507c44088637f7d036a8c","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:25.410Z","job_size_bytes":2592,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-33bc32083b3df6335141671f: start","job_status":"start","queue_duration_s":2.466075,"scheduling_latency_s":2.466146}2221gitlab # [ 453.304116] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:27 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1182222gitlab # [ 453.306289] gitaly[920]: time="2026-09-18T22:17:27.920Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=4 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9H4ZVD2HABF48Y445C9YH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:17:27.899" grpc.time_ms=20.609 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2223gitlab # [ 453.322339] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:27.961Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","2bfee2a46db1f2ed9c10aa12"],"class":"WebHooks::LogExecutionWorker","jid":"33bc32083b3df6335141671f","created_at":"2026-09-18T22:17:25.395Z","trace_propagation_headers":{"sentry-trace":"6b7e765b4901440abc1c3af372103d0e-0697c1014f19445e","baggage":"sentry-trace_id=6b7e765b4901440abc1c3af372103d0e,sentry-release=Unknown"},"correlation_id":"01M2V9E1HVTPTGW3WY4BJ0ZDEN","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2e919669f7cfde647139fd084a77da164bec2ab45f9507c44088637f7d036a8c","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:25.410Z","job_size_bytes":2592,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-33bc32083b3df6335141671f: done: 0.08496 sec","job_status":"done","queue_duration_s":2.466075,"scheduling_latency_s":2.466146,"redis_calls":10,"redis_duration_s":0.003751,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000575,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002233,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000943,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.017,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.017,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.052063,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00073924,"duration_s":0.08496,"completed_at":"2026-09-18T22:17:27.961Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021115,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2224gitlab # [ 453.367308] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:27.965Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"623d4597228c2bc078284355","created_at":"2026-09-18T22:17:26.173Z","trace_propagation_headers":{"sentry-trace":"774ba1088b0c443887d104a25382b8fc-1ebda2d718a94447","baggage":"sentry-trace_id=774ba1088b0c443887d104a25382b8fc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9H34H4HPM0T47TKM1WC7W","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:26.178Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-623d4597228c2bc078284355: start","job_status":"start","queue_duration_s":1.786403,"scheduling_latency_s":1.786452}2225gitlab # [ 453.392260] gitaly[920]: time="2026-09-18T22:17:28.032Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H53NH8SW932VRV84VTDC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:17:28.013" pid=920 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2226gitlab # [ 453.402846] gitaly[920]: time="2026-09-18T22:17:28.032Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H53NH8SW932VRV84VTDC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:17:28.013" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2227gitlab # [ 453.416498] gitlab-workhorse[822]: time="2026-09-18T22:17:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672228gitlab # [ 453.418575] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:28 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1082229gitlab # [ 453.420629] gitaly[920]: time="2026-09-18T22:17:28.033Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H53NH8SW932VRV84VTDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:17:28.013" grpc.time_ms=19.445 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2230gitlab # [ 453.523232] gitaly[920]: time="2026-09-18T22:17:28.163Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V9H34H4HPM0T47TKM1WC7W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T22:17:28.162" grpc.time_ms=0.805 pid=920 span.kind=server system=grpc2231gitlab # [ 453.548427] gitaly[920]: time="2026-09-18T22:17:28.188Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9H58W9Y3RW853RGWTZ037 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:17:28.176" grpc.time_ms=11.972 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2232gitlab # [ 453.562722] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:28 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 962233gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9'2234gitlab # [ 453.588329] gitaly[920]: time="2026-09-18T22:17:28.228Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V9H34H4HPM0T47TKM1WC7W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T22:17:28.227" grpc.time_ms=0.667 pid=920 span.kind=server system=grpc2235gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9', in 0.06 seconds)2236gitlab # [ 453.626194] gitaly[920]: time="2026-09-18T22:17:28.266Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V9H34H4HPM0T47TKM1WC7W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T22:17:28.265" grpc.time_ms=0.678 pid=920 span.kind=server system=grpc2237gitlab # [ 453.647371] gitaly[920]: time="2026-09-18T22:17:28.277Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H34H4HPM0T47TKM1WC7W diskcache=7d8ec86b-e557-4519-8940-01c1691a23d1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-18T22:17:58.219" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:28.120" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2238gitlab # [ 453.666111] gitaly[920]: time="2026-09-18T22:17:28.277Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=144 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7139 command.oublock=0 command.real_time_ms=149 command.spawn_token_fork_ms=1 command.system_time_ms=75 command.user_time_ms=69 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H34H4HPM0T47TKM1WC7W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-18T22:17:58.219" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:28.120" grpc.time_ms=157.125 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2239gitlab # [ 453.687860] nixbot[3643]: INFO: ::ffff:127.0.0.1:43140 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9 HTTP/1.1" 200 OK2240gitlab # [ 453.690865] gitaly[920]: time="2026-09-18T22:17:28.330Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H5BZPR4J4DVCXNGXRRWB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:17:28.308" pid=920 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2241gitlab # [ 453.704917] gitaly[920]: time="2026-09-18T22:17:28.330Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1100 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=10 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H5BZPR4J4DVCXNGXRRWB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:17:28.308" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2242gitlab # [ 453.722596] gitlab-workhorse[822]: time="2026-09-18T22:17:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162243gitlab # [ 453.725054] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:28 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 1392244gitlab # [ 453.727465] gitaly[920]: time="2026-09-18T22:17:28.330Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1100 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=10 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H5BZPR4J4DVCXNGXRRWB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:17:28.308" grpc.time_ms=22.159 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2245gitlab # [ 453.750723] gitaly[920]: time="2026-09-18T22:17:28.391Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9H34H4HPM0T47TKM1WC7W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-18T22:17:58.489" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:28.389" grpc.time_ms=1.346 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2246gitlab # [ 453.808098] gitaly[920]: time="2026-09-18T22:17:28.448Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H34H4HPM0T47TKM1WC7W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T22:17:58.546" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:28.446" grpc.time_ms=1.289 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2247gitlab # [ 453.829767] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:28.469Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"623d4597228c2bc078284355","created_at":"2026-09-18T22:17:26.173Z","trace_propagation_headers":{"sentry-trace":"774ba1088b0c443887d104a25382b8fc-1ebda2d718a94447","baggage":"sentry-trace_id=774ba1088b0c443887d104a25382b8fc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9H34H4HPM0T47TKM1WC7W","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:26.178Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3513,"job_status":"rescheduled","message":"PipelineProcessWorker JID-623d4597228c2bc078284355: rescheduled"}2248gitlab # [ 453.849623] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:28.486Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"623d4597228c2bc078284355","created_at":"2026-09-18T22:17:26.173Z","trace_propagation_headers":{"sentry-trace":"774ba1088b0c443887d104a25382b8fc-1ebda2d718a94447","baggage":"sentry-trace_id=774ba1088b0c443887d104a25382b8fc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9H34H4HPM0T47TKM1WC7W","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:26.178Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-623d4597228c2bc078284355: done: 0.52148 sec","job_status":"done","queue_duration_s":1.786403,"scheduling_latency_s":1.786452,"gitaly_calls":3,"gitaly_duration_s":0.176005,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.030394,"redis_read_bytes":148,"redis_write_bytes":18009,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000859,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00161,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.00715,"redis_queues_read_bytes":26,"redis_queues_write_bytes":12308,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.012852,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.002167,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.002265,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002632,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.059,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.016,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.016,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.03,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.267201,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.43508282,"duration_s":0.52148,"completed_at":"2026-09-18T22:17:28.486Z","load_balancing_strategy":"primary","db_duration_s":0.061212,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2249gitlab # [ 453.904257] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:28.489Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","2bd5eb4ab0a4a19cd1db91b9"],"class":"WebHooks::LogExecutionWorker","jid":"655e1db85d9e33c41d258450","created_at":"2026-09-18T22:17:27.753Z","trace_propagation_headers":{"sentry-trace":"cf1e6d89abb149bfb291e4fdc7e12c9d-2d5585413fb74f47","baggage":"sentry-trace_id=cf1e6d89abb149bfb291e4fdc7e12c9d,sentry-release=Unknown"},"correlation_id":"01M2V9GTRNNR62RGJVFPBY7CY9","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c58705e9aefd34dc88455a04b613acc94b2e5f0bcb9485f7a3f13ddc614bf0f3","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:27.759Z","job_size_bytes":2592,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-655e1db85d9e33c41d258450: start","job_status":"start","queue_duration_s":0.729676,"scheduling_latency_s":0.729711}2250gitlab # [ 453.921585] gitaly[920]: time="2026-09-18T22:17:28.474Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H5HQ7F0V7BFCYPRHF1TE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T22:17:58.472" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:28.473" grpc.time_ms=1.022 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2251gitlab # [ 453.934857] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:28.549Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","2bd5eb4ab0a4a19cd1db91b9"],"class":"WebHooks::LogExecutionWorker","jid":"655e1db85d9e33c41d258450","created_at":"2026-09-18T22:17:27.753Z","trace_propagation_headers":{"sentry-trace":"cf1e6d89abb149bfb291e4fdc7e12c9d-2d5585413fb74f47","baggage":"sentry-trace_id=cf1e6d89abb149bfb291e4fdc7e12c9d,sentry-release=Unknown"},"correlation_id":"01M2V9GTRNNR62RGJVFPBY7CY9","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c58705e9aefd34dc88455a04b613acc94b2e5f0bcb9485f7a3f13ddc614bf0f3","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:27.759Z","job_size_bytes":2592,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-655e1db85d9e33c41d258450: done: 0.060325 sec","job_status":"done","queue_duration_s":0.729676,"scheduling_latency_s":0.729711,"redis_calls":7,"redis_duration_s":0.012455,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.011475,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025733,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.060325,"completed_at":"2026-09-18T22:17:28.549Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004864,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2252gitlab # [ 453.979438] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:28.552Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"8f580776c1254e8458739d33","created_at":"2026-09-18T22:17:27.844Z","trace_propagation_headers":{"sentry-trace":"6b7e765b4901440abc1c3af372103d0e-50ead4aef6014681","baggage":"sentry-trace_id=6b7e765b4901440abc1c3af372103d0e,sentry-release=Unknown"},"correlation_id":"01M2V9E1HVTPTGW3WY4BJ0ZDEN","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:27.858Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-8f580776c1254e8458739d33: start","job_status":"start","queue_duration_s":0.694302,"scheduling_latency_s":0.694344}2253gitlab # [ 453.997291] gitaly[920]: time="2026-09-18T22:17:28.505Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=592 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9H5HQ7F0V7BFCYPRHF1TE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-18T22:17:58.491" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:28.493" grpc.time_ms=12.522 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2254gitlab # [ 454.011562] gitaly[920]: time="2026-09-18T22:17:28.540Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M2V9H5HQ7F0V7BFCYPRHF1TE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T22:17:38.197" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:28.517" grpc.time_ms=22.842 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2255gitlab # [ 454.025609] gitaly[920]: time="2026-09-18T22:17:28.613Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H5HQ7F0V7BFCYPRHF1TE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-18T22:17:38.071" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:17:28.612" grpc.time_ms=0.811 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2256gitlab # [ 454.038775] gitaly[920]: time="2026-09-18T22:17:28.643Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=3 command.system_time_ms=13 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H5HQ7F0V7BFCYPRHF1TE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-18T22:17:38.082" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:28.623" grpc.time_ms=20.13 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2257gitlab # [ 454.058090] gitaly[920]: time="2026-09-18T22:17:28.698Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V9H5HQ7F0V7BFCYPRHF1TE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T22:17:28.697" grpc.time_ms=0.792 pid=920 span.kind=server system=grpc2258gitlab # [ 454.070811] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:28.710Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"8f580776c1254e8458739d33","created_at":"2026-09-18T22:17:27.844Z","trace_propagation_headers":{"sentry-trace":"6b7e765b4901440abc1c3af372103d0e-50ead4aef6014681","baggage":"sentry-trace_id=6b7e765b4901440abc1c3af372103d0e,sentry-release=Unknown"},"correlation_id":"01M2V9E1HVTPTGW3WY4BJ0ZDEN","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:27.858Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-8f580776c1254e8458739d33: done: 0.157563 sec","job_status":"done","queue_duration_s":0.694302,"scheduling_latency_s":0.694344,"redis_calls":11,"redis_duration_s":0.0029430000000000003,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000653,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001737,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000553,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.014,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.108759,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036914,"duration_s":0.157563,"completed_at":"2026-09-18T22:17:28.710Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.044837,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2259gitlab # [ 454.117998] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:28.712Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"9cd7bb69a750570f0a5b97e1","created_at":"2026-09-18T22:17:28.103Z","trace_propagation_headers":{"sentry-trace":"774ba1088b0c443887d104a25382b8fc-10d7ba254c00463b","baggage":"sentry-trace_id=774ba1088b0c443887d104a25382b8fc,sentry-release=Unknown"},"correlation_id":"01M2V9H34H4HPM0T47TKM1WC7W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:28.107Z","job_size_bytes":23,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-9cd7bb69a750570f0a5b97e1: start","job_status":"start","queue_duration_s":0.604354,"scheduling_latency_s":0.604388}2260gitlab # [ 454.135048] gitaly[920]: time="2026-09-18T22:17:28.745Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V9H5HQ7F0V7BFCYPRHF1TE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T22:17:28.745" grpc.time_ms=0.561 pid=920 span.kind=server system=grpc2261gitlab # [ 454.144969] gitaly[920]: time="2026-09-18T22:17:28.760Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H5HQ7F0V7BFCYPRHF1TE diskcache=d7e5ab44-3243-4242-b53a-a0899871b6e9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-18T22:17:38.108" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:17:28.648" pid=920 ref=refs/keep-around/a4bc83de92473a228fc3f855cea6097a4c6042c9 remote_ip="2001:db8:1::1" revision=a4bc83de92473a228fc3f855cea6097a4c6042c9 span.kind=server system=grpc username=root2262gitlab # [ 454.156606] gitaly[920]: time="2026-09-18T22:17:28.760Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=91 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5221 command.oublock=8 command.real_time_ms=99 command.spawn_token_fork_ms=2 command.system_time_ms=58 command.user_time_ms=33 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H5HQ7F0V7BFCYPRHF1TE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-18T22:17:38.108" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T22:17:28.648" grpc.time_ms=111.827 pid=920 ref=refs/keep-around/a4bc83de92473a228fc3f855cea6097a4c6042c9 remote_ip="2001:db8:1::1" revision=a4bc83de92473a228fc3f855cea6097a4c6042c9 span.kind=server system=grpc username=root2263gitlab # [ 454.171436] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:28.795Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"9cd7bb69a750570f0a5b97e1","created_at":"2026-09-18T22:17:28.103Z","trace_propagation_headers":{"sentry-trace":"774ba1088b0c443887d104a25382b8fc-10d7ba254c00463b","baggage":"sentry-trace_id=774ba1088b0c443887d104a25382b8fc,sentry-release=Unknown"},"correlation_id":"01M2V9H34H4HPM0T47TKM1WC7W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:28.107Z","job_size_bytes":23,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-9cd7bb69a750570f0a5b97e1: done: 0.083409 sec","job_status":"done","queue_duration_s":0.604354,"scheduling_latency_s":0.604388,"redis_calls":7,"redis_duration_s":0.004444,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003657,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000787,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057184,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.083409,"completed_at":"2026-09-18T22:17:28.795Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018105,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2264gitlab # [ 454.215364] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:28.799Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"7c0e35b5d3061e0be570eb07","created_at":"2026-09-18T22:17:28.287Z","trace_propagation_headers":{"sentry-trace":"774ba1088b0c443887d104a25382b8fc-10d7ba254c00463b","baggage":"sentry-trace_id=774ba1088b0c443887d104a25382b8fc,sentry-release=Unknown"},"correlation_id":"01M2V9H34H4HPM0T47TKM1WC7W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:28.291Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-7c0e35b5d3061e0be570eb07: start","job_status":"start","queue_duration_s":0.507842,"scheduling_latency_s":0.507882}2265gitlab # [ 454.233781] gitaly[920]: time="2026-09-18T22:17:28.769Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H5HQ7F0V7BFCYPRHF1TE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T22:17:58.765" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:28.769" grpc.time_ms=0.603 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2266gitlab # [ 454.246639] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:28.840Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"7c0e35b5d3061e0be570eb07","created_at":"2026-09-18T22:17:28.287Z","trace_propagation_headers":{"sentry-trace":"774ba1088b0c443887d104a25382b8fc-10d7ba254c00463b","baggage":"sentry-trace_id=774ba1088b0c443887d104a25382b8fc,sentry-release=Unknown"},"correlation_id":"01M2V9H34H4HPM0T47TKM1WC7W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:28.291Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-7c0e35b5d3061e0be570eb07: done: 0.0417 sec","job_status":"done","queue_duration_s":0.507842,"scheduling_latency_s":0.507882,"redis_calls":7,"redis_duration_s":0.001451,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000997,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000454,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025458,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0417,"completed_at":"2026-09-18T22:17:28.840Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008867,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2267gitlab # [ 454.290036] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:28.842Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"fa22adec09013a07d7fd72f4","created_at":"2026-09-18T22:17:28.302Z","trace_propagation_headers":{"sentry-trace":"774ba1088b0c443887d104a25382b8fc-10d7ba254c00463b","baggage":"sentry-trace_id=774ba1088b0c443887d104a25382b8fc,sentry-release=Unknown"},"correlation_id":"01M2V9H34H4HPM0T47TKM1WC7W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:28.307Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-fa22adec09013a07d7fd72f4: start","job_status":"start","queue_duration_s":0.535408,"scheduling_latency_s":0.535442}2268gitlab # [ 454.306397] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:28.894Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"fa22adec09013a07d7fd72f4","created_at":"2026-09-18T22:17:28.302Z","trace_propagation_headers":{"sentry-trace":"774ba1088b0c443887d104a25382b8fc-10d7ba254c00463b","baggage":"sentry-trace_id=774ba1088b0c443887d104a25382b8fc,sentry-release=Unknown"},"correlation_id":"01M2V9H34H4HPM0T47TKM1WC7W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:28.307Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-fa22adec09013a07d7fd72f4: done: 0.052168 sec","job_status":"done","queue_duration_s":0.535408,"scheduling_latency_s":0.535442,"redis_calls":7,"redis_duration_s":0.007452,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004229,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003223,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028334,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.052168,"completed_at":"2026-09-18T22:17:28.894Z","load_balancing_strategy":"primary","db_duration_s":0.01338,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2269gitlab # [ 454.349392] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:28.897Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"b7f40a84e34e3eb757bdab1a","created_at":"2026-09-18T22:17:28.328Z","trace_propagation_headers":{"sentry-trace":"774ba1088b0c443887d104a25382b8fc-10d7ba254c00463b","baggage":"sentry-trace_id=774ba1088b0c443887d104a25382b8fc,sentry-release=Unknown"},"correlation_id":"01M2V9H34H4HPM0T47TKM1WC7W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:28.333Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b7f40a84e34e3eb757bdab1a: start","job_status":"start","queue_duration_s":0.562977,"scheduling_latency_s":0.563013}2270gitlab # [ 454.365781] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:28 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a4bc83de92473a228fc3f855cea6097a4c6042c9 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 5442271gitlab # [ 454.368669] nixbot[3643]: {"ts": "2026-09-18T22:17:28.922Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a4bc83de92473a228fc3f855cea6097a4c6042c9 \"HTTP/1.1 201 Created\""}2272gitlab # [ 454.371441] nixbot[3643]: {"ts": "2026-09-18T22:17:28.939Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-a4bc83de9247-5"}2273gitlab # [ 454.373943] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:28.942Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"b7f40a84e34e3eb757bdab1a","created_at":"2026-09-18T22:17:28.328Z","trace_propagation_headers":{"sentry-trace":"774ba1088b0c443887d104a25382b8fc-10d7ba254c00463b","baggage":"sentry-trace_id=774ba1088b0c443887d104a25382b8fc,sentry-release=Unknown"},"correlation_id":"01M2V9H34H4HPM0T47TKM1WC7W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:28.333Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b7f40a84e34e3eb757bdab1a: done: 0.045163 sec","job_status":"done","queue_duration_s":0.562977,"scheduling_latency_s":0.563013,"redis_calls":10,"redis_duration_s":0.002218,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001142,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000554,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000522,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.045163,"completed_at":"2026-09-18T22:17:28.942Z","load_balancing_strategy":"primary","db_duration_s":0.009377,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2274gitlab # [ 454.418072] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:28.944Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"76bc91506b464426600418b8","created_at":"2026-09-18T22:17:28.336Z","trace_propagation_headers":{"sentry-trace":"774ba1088b0c443887d104a25382b8fc-10d7ba254c00463b","baggage":"sentry-trace_id=774ba1088b0c443887d104a25382b8fc,sentry-release=Unknown"},"correlation_id":"01M2V9H34H4HPM0T47TKM1WC7W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:28.340Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-76bc91506b464426600418b8: start","job_status":"start","queue_duration_s":0.603758,"scheduling_latency_s":0.603792}2275gitlab # [ 454.434974] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:28.992Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"76bc91506b464426600418b8","created_at":"2026-09-18T22:17:28.336Z","trace_propagation_headers":{"sentry-trace":"774ba1088b0c443887d104a25382b8fc-10d7ba254c00463b","baggage":"sentry-trace_id=774ba1088b0c443887d104a25382b8fc,sentry-release=Unknown"},"correlation_id":"01M2V9H34H4HPM0T47TKM1WC7W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:28.340Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-76bc91506b464426600418b8: done: 0.048606 sec","job_status":"done","queue_duration_s":0.603758,"scheduling_latency_s":0.603792,"redis_calls":7,"redis_duration_s":0.001979,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001439,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00054,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031633,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048606,"completed_at":"2026-09-18T22:17:28.992Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011548,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2276gitlab # [ 454.480177] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:28.994Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"f0f5ac2e08b85814d4ec5007","created_at":"2026-09-18T22:17:28.341Z","trace_propagation_headers":{"sentry-trace":"774ba1088b0c443887d104a25382b8fc-10d7ba254c00463b","baggage":"sentry-trace_id=774ba1088b0c443887d104a25382b8fc,sentry-release=Unknown"},"correlation_id":"01M2V9H34H4HPM0T47TKM1WC7W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:28.346Z","job_size_bytes":19,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-f0f5ac2e08b85814d4ec5007: start","job_status":"start","queue_duration_s":0.647945,"scheduling_latency_s":0.647984}2277gitlab # [ 454.496779] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:29.047Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"f0f5ac2e08b85814d4ec5007","created_at":"2026-09-18T22:17:28.341Z","trace_propagation_headers":{"sentry-trace":"774ba1088b0c443887d104a25382b8fc-10d7ba254c00463b","baggage":"sentry-trace_id=774ba1088b0c443887d104a25382b8fc,sentry-release=Unknown"},"correlation_id":"01M2V9H34H4HPM0T47TKM1WC7W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:28.346Z","job_size_bytes":19,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-f0f5ac2e08b85814d4ec5007: done: 0.052829 sec","job_status":"done","queue_duration_s":0.647945,"scheduling_latency_s":0.647984,"redis_calls":8,"redis_duration_s":0.002215,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001721,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000494,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.052829,"completed_at":"2026-09-18T22:17:29.047Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013065,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2278gitlab # [ 454.539902] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:29.050Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"174c2cc2ab2037b0de7b4343","created_at":"2026-09-18T22:17:28.348Z","trace_propagation_headers":{"sentry-trace":"774ba1088b0c443887d104a25382b8fc-10d7ba254c00463b","baggage":"sentry-trace_id=774ba1088b0c443887d104a25382b8fc,sentry-release=Unknown"},"correlation_id":"01M2V9H34H4HPM0T47TKM1WC7W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:28.354Z","job_size_bytes":66,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-174c2cc2ab2037b0de7b4343: start","job_status":"start","queue_duration_s":0.696138,"scheduling_latency_s":0.696188}2279gitlab # [ 454.557769] nixbot[3643]: {"ts": "2026-09-18T22:17:29.114Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-a4bc83de9247-5", "argv0": "bwrap"}2280gitlab # [ 454.560130] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:29.098Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"174c2cc2ab2037b0de7b4343","created_at":"2026-09-18T22:17:28.348Z","trace_propagation_headers":{"sentry-trace":"774ba1088b0c443887d104a25382b8fc-10d7ba254c00463b","baggage":"sentry-trace_id=774ba1088b0c443887d104a25382b8fc,sentry-release=Unknown"},"correlation_id":"01M2V9H34H4HPM0T47TKM1WC7W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:28.354Z","job_size_bytes":66,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-174c2cc2ab2037b0de7b4343: done: 0.047234 sec","job_status":"done","queue_duration_s":0.696138,"scheduling_latency_s":0.696188,"redis_calls":7,"redis_duration_s":0.002461,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001567,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000894,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033631,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.047234,"completed_at":"2026-09-18T22:17:29.097Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00463,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2281gitlab # [ 454.603859] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:29.100Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"819aafe87485f86d40fc9125","created_at":"2026-09-18T22:17:28.355Z","trace_propagation_headers":{"sentry-trace":"774ba1088b0c443887d104a25382b8fc-10d7ba254c00463b","baggage":"sentry-trace_id=774ba1088b0c443887d104a25382b8fc,sentry-release=Unknown"},"correlation_id":"01M2V9H34H4HPM0T47TKM1WC7W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:28.359Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-819aafe87485f86d40fc9125: start","job_status":"start","queue_duration_s":0.741552,"scheduling_latency_s":0.741588}2282gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9'2283gitlab # [ 454.620752] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:29.145Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"819aafe87485f86d40fc9125","created_at":"2026-09-18T22:17:28.355Z","trace_propagation_headers":{"sentry-trace":"774ba1088b0c443887d104a25382b8fc-10d7ba254c00463b","baggage":"sentry-trace_id=774ba1088b0c443887d104a25382b8fc,sentry-release=Unknown"},"correlation_id":"01M2V9H34H4HPM0T47TKM1WC7W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:28.359Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-819aafe87485f86d40fc9125: done: 0.044984 sec","job_status":"done","queue_duration_s":0.741552,"scheduling_latency_s":0.741588,"redis_calls":7,"redis_duration_s":0.007999,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002326,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005673,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044984,"completed_at":"2026-09-18T22:17:29.145Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006704,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2284gitlab # [ 454.663000] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:29.148Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"9aceffd7ff9851136b543dd1","created_at":"2026-09-18T22:17:28.360Z","trace_propagation_headers":{"sentry-trace":"774ba1088b0c443887d104a25382b8fc-10d7ba254c00463b","baggage":"sentry-trace_id=774ba1088b0c443887d104a25382b8fc,sentry-release=Unknown"},"correlation_id":"01M2V9H34H4HPM0T47TKM1WC7W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:28.365Z","job_size_bytes":6,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-9aceffd7ff9851136b543dd1: start","job_status":"start","queue_duration_s":0.782787,"scheduling_latency_s":0.782822}2285gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9', in 0.08 seconds)2286gitlab # [ 454.680558] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:29.171Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"9aceffd7ff9851136b543dd1","created_at":"2026-09-18T22:17:28.360Z","trace_propagation_headers":{"sentry-trace":"774ba1088b0c443887d104a25382b8fc-10d7ba254c00463b","baggage":"sentry-trace_id=774ba1088b0c443887d104a25382b8fc,sentry-release=Unknown"},"correlation_id":"01M2V9H34H4HPM0T47TKM1WC7W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:28.365Z","job_size_bytes":6,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-9aceffd7ff9851136b543dd1: done: 0.023812 sec","job_status":"done","queue_duration_s":0.782787,"scheduling_latency_s":0.782822,"redis_calls":7,"redis_duration_s":0.002193,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001563,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00063,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015257,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023812,"completed_at":"2026-09-18T22:17:29.171Z","load_balancing_strategy":"primary","db_duration_s":0.00057,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2287(finished: subtest: push delivers the webhook, in 98.81 seconds)2288subtest: eval and build post commit statuses2289gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses2290gitlab # [ 454.724321] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:29.174Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"44feb0a9425e328210d622a2","created_at":"2026-09-18T22:17:28.366Z","trace_propagation_headers":{"sentry-trace":"774ba1088b0c443887d104a25382b8fc-10d7ba254c00463b","baggage":"sentry-trace_id=774ba1088b0c443887d104a25382b8fc,sentry-release=Unknown"},"correlation_id":"01M2V9H34H4HPM0T47TKM1WC7W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:28.369Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-44feb0a9425e328210d622a2: start","job_status":"start","queue_duration_s":0.804394,"scheduling_latency_s":0.804423}2291gitlab # [ 454.740133] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:29.217Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"44feb0a9425e328210d622a2","created_at":"2026-09-18T22:17:28.366Z","trace_propagation_headers":{"sentry-trace":"774ba1088b0c443887d104a25382b8fc-10d7ba254c00463b","baggage":"sentry-trace_id=774ba1088b0c443887d104a25382b8fc,sentry-release=Unknown"},"correlation_id":"01M2V9H34H4HPM0T47TKM1WC7W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:28.369Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-44feb0a9425e328210d622a2: done: 0.043979 sec","job_status":"done","queue_duration_s":0.804394,"scheduling_latency_s":0.804423,"redis_calls":7,"redis_duration_s":0.002392,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001751,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000641,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02975,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043979,"completed_at":"2026-09-18T22:17:29.217Z","load_balancing_strategy":"primary","db_duration_s":0.007086,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2292gitlab # [ 454.782355] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:29.220Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"ca14c63f896ffb3c1ffd68de","created_at":"2026-09-18T22:17:28.470Z","trace_propagation_headers":{"sentry-trace":"774ba1088b0c443887d104a25382b8fc-10d7ba254c00463b","baggage":"sentry-trace_id=774ba1088b0c443887d104a25382b8fc,sentry-release=Unknown"},"correlation_id":"01M2V9H34H4HPM0T47TKM1WC7W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:28.475Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ca14c63f896ffb3c1ffd68de: start","job_status":"start","queue_duration_s":0.744797,"scheduling_latency_s":0.74483}2293gitlab # [ 454.798474] nixbot[3643]: INFO: ::ffff:127.0.0.1:43148 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a4bc83de92473a228fc3f855cea6097a4c6042c9 HTTP/1.1" 200 OK2294gitlab # [ 454.800923] nix-daemon[3814]: accepted connection from pid 4910, user nixbot2295gitlab # [ 454.801991] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:29.271Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"ca14c63f896ffb3c1ffd68de","created_at":"2026-09-18T22:17:28.470Z","trace_propagation_headers":{"sentry-trace":"774ba1088b0c443887d104a25382b8fc-10d7ba254c00463b","baggage":"sentry-trace_id=774ba1088b0c443887d104a25382b8fc,sentry-release=Unknown"},"correlation_id":"01M2V9H34H4HPM0T47TKM1WC7W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:28.475Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ca14c63f896ffb3c1ffd68de: done: 0.05165 sec","job_status":"done","queue_duration_s":0.744797,"scheduling_latency_s":0.74483,"redis_calls":8,"redis_duration_s":0.003552,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002661,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000891,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035432,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.05165,"completed_at":"2026-09-18T22:17:29.271Z","load_balancing_strategy":"primary","db_duration_s":0.00842,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2296gitlab # [ 454.844193] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:29.276Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"cda4dfc8b368e21798c05dd7","created_at":"2026-09-18T22:17:28.783Z","trace_propagation_headers":{"sentry-trace":"647c2e0f975c4732a5e0fe61f5540dd3-f5a559b8e25448bf","baggage":"sentry-trace_id=647c2e0f975c4732a5e0fe61f5540dd3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9H5HQ7F0V7BFCYPRHF1TE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:28.790Z","job_size_bytes":65,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-cda4dfc8b368e21798c05dd7: start","job_status":"start","queue_duration_s":0.486194,"scheduling_latency_s":0.486231}2297gitlab # [ 454.861810] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:29.356Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"cda4dfc8b368e21798c05dd7","created_at":"2026-09-18T22:17:28.783Z","trace_propagation_headers":{"sentry-trace":"647c2e0f975c4732a5e0fe61f5540dd3-f5a559b8e25448bf","baggage":"sentry-trace_id=647c2e0f975c4732a5e0fe61f5540dd3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9H5HQ7F0V7BFCYPRHF1TE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:28.790Z","job_size_bytes":65,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-cda4dfc8b368e21798c05dd7: done: 0.079958 sec","job_status":"done","queue_duration_s":0.486194,"scheduling_latency_s":0.486231,"redis_calls":7,"redis_duration_s":0.003935,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002841,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001094,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051071,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.079958,"completed_at":"2026-09-18T22:17:29.356Z","load_balancing_strategy":"primary","db_duration_s":0.015919,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2298gitlab # [ 454.906998] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:29.360Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b5ec0180f71401c8379474a4","created_at":"2026-09-18T22:17:28.791Z","trace_propagation_headers":{"sentry-trace":"647c2e0f975c4732a5e0fe61f5540dd3-f5a559b8e25448bf","baggage":"sentry-trace_id=647c2e0f975c4732a5e0fe61f5540dd3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9H5HQ7F0V7BFCYPRHF1TE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:28.796Z","job_size_bytes":65,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b5ec0180f71401c8379474a4: start","job_status":"start","queue_duration_s":0.563388,"scheduling_latency_s":0.563445}2299gitlab # [ 454.925342] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:29.498Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b5ec0180f71401c8379474a4","created_at":"2026-09-18T22:17:28.791Z","trace_propagation_headers":{"sentry-trace":"647c2e0f975c4732a5e0fe61f5540dd3-f5a559b8e25448bf","baggage":"sentry-trace_id=647c2e0f975c4732a5e0fe61f5540dd3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9H5HQ7F0V7BFCYPRHF1TE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:28.796Z","job_size_bytes":65,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b5ec0180f71401c8379474a4: done: 0.138255 sec","job_status":"done","queue_duration_s":0.563388,"scheduling_latency_s":0.563445,"redis_calls":10,"redis_duration_s":0.0044150000000000005,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001962,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.002453,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.074646,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.138255,"completed_at":"2026-09-18T22:17:29.498Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.045767,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2300gitlab # [ 454.969950] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:29.504Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a17e9e59757df6f86c5750d8","created_at":"2026-09-18T22:17:28.891Z","trace_propagation_headers":{"sentry-trace":"647c2e0f975c4732a5e0fe61f5540dd3-f5a559b8e25448bf","baggage":"sentry-trace_id=647c2e0f975c4732a5e0fe61f5540dd3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9H5HQ7F0V7BFCYPRHF1TE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:28.895Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a17e9e59757df6f86c5750d8: start","job_status":"start","queue_duration_s":0.608894,"scheduling_latency_s":0.608939}2301gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses, in 0.27 seconds)2302gitlab # [ 454.986654] gitaly[920]: time="2026-09-18T22:17:29.545Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H6K4K3RJPEQ04W7RP452 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T22:17:59.244" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:29.545" grpc.time_ms=0.73 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2303gitlab # [ 454.998991] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:29 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1642304gitlab # [ 455.002115] gitaly[920]: time="2026-09-18T22:17:29.629Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9H5HQ7F0V7BFCYPRHF1TE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-18T22:17:59.727" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:29.628" grpc.time_ms=1.38 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2305gitlab # [ 455.060143] gitaly[920]: time="2026-09-18T22:17:29.700Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H5HQ7F0V7BFCYPRHF1TE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T22:17:59.798" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:29.699" grpc.time_ms=1.092 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2306gitlab # [ 455.098862] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:29.737Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a17e9e59757df6f86c5750d8","created_at":"2026-09-18T22:17:28.891Z","trace_propagation_headers":{"sentry-trace":"647c2e0f975c4732a5e0fe61f5540dd3-f5a559b8e25448bf","baggage":"sentry-trace_id=647c2e0f975c4732a5e0fe61f5540dd3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9H5HQ7F0V7BFCYPRHF1TE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:28.895Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a17e9e59757df6f86c5750d8: done: 0.23292 sec","job_status":"done","queue_duration_s":0.608894,"scheduling_latency_s":0.608939,"gitaly_calls":2,"gitaly_duration_s":0.009932,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.019934,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.004246,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002373,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000494,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.004101,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000547,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.001264,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002663,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.058,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.009,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.028,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.15337,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.16721194,"duration_s":0.23292,"completed_at":"2026-09-18T22:17:29.737Z","load_balancing_strategy":"primary","db_duration_s":0.065003,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2307gitlab # [ 455.152232] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:29.742Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"7c121c3abe8a03bb70e6d7f0","created_at":"2026-09-18T22:17:29.598Z","trace_propagation_headers":{"sentry-trace":"647c2e0f975c4732a5e0fe61f5540dd3-946b88ba14444f50","baggage":"sentry-trace_id=647c2e0f975c4732a5e0fe61f5540dd3,sentry-release=Unknown"},"correlation_id":"01M2V9H5HQ7F0V7BFCYPRHF1TE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:29.601Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-7c121c3abe8a03bb70e6d7f0: start","job_status":"start","queue_duration_s":0.140728,"scheduling_latency_s":0.140789}2308gitlab # [ 455.184529] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:29.824Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"7c121c3abe8a03bb70e6d7f0","created_at":"2026-09-18T22:17:29.598Z","trace_propagation_headers":{"sentry-trace":"647c2e0f975c4732a5e0fe61f5540dd3-946b88ba14444f50","baggage":"sentry-trace_id=647c2e0f975c4732a5e0fe61f5540dd3,sentry-release=Unknown"},"correlation_id":"01M2V9H5HQ7F0V7BFCYPRHF1TE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:29.601Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-7c121c3abe8a03bb70e6d7f0: done: 0.082038 sec","job_status":"done","queue_duration_s":0.140728,"scheduling_latency_s":0.140789,"redis_calls":7,"redis_duration_s":0.002925,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002026,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000899,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.060981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.082038,"completed_at":"2026-09-18T22:17:29.824Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010802,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2309gitlab # [ 455.348236] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:29.987Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"e68f90b88e1f57f58b6b2ec2","created_at":"2026-09-18T22:17:29.961Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"365dd232556975b57d3d53250247ee29","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:29.983Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-e68f90b88e1f57f58b6b2ec2: start","job_status":"start","queue_duration_s":0.004137,"scheduling_latency_s":0.004209}2310gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses2311gitlab # [ 456.168489] gitaly[920]: time="2026-09-18T22:17:30.807Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H7T49J8WT4YR1BGSPPJ9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T22:18:00.505" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:30.806" grpc.time_ms=1.478 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2312gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses, in 0.24 seconds)2313gitlab # [ 456.235393] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:30 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1822314gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses2315gitlab # [ 457.374558] gitaly[920]: time="2026-09-18T22:17:32.014Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9H90TCF1YEG8ZB9Z9KWWC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T22:18:02.011" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:32.012" grpc.time_ms=1.456 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2316gitlab # [ 457.433254] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:32 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1412317gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses, in 0.20 seconds)2318gitlab # [ 457.446357] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:32.084Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"e68f90b88e1f57f58b6b2ec2","created_at":"2026-09-18T22:17:29.961Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"365dd232556975b57d3d53250247ee29","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:29.983Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-e68f90b88e1f57f58b6b2ec2: done: 2.097204 sec","job_status":"done","queue_duration_s":0.004137,"scheduling_latency_s":0.004209,"redis_calls":564,"redis_duration_s":1.2308569999999999,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00305,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009772,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":1.218035,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.947495,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":2.097204,"completed_at":"2026-09-18T22:17:32.084Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001719,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2319gitlab # [ 457.531055] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:32.089Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"0da48a1728de161b5d62e70c","created_at":"2026-09-18T22:17:30.007Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34be4823274a6fb1be86fec3ecaf1fce","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:30.027Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-0da48a1728de161b5d62e70c: start","job_status":"start","queue_duration_s":2.061832,"scheduling_latency_s":2.061892}2320gitlab # [ 457.572620] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:32.211Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"0da48a1728de161b5d62e70c","created_at":"2026-09-18T22:17:30.007Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34be4823274a6fb1be86fec3ecaf1fce","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:30.027Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-0da48a1728de161b5d62e70c: done: 0.122713 sec","job_status":"done","queue_duration_s":2.061832,"scheduling_latency_s":2.061892,"redis_calls":18,"redis_duration_s":0.009406000000000001,"redis_read_bytes":20,"redis_write_bytes":4698,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002187,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000627,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.005067,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001525,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.083181,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.122713,"completed_at":"2026-09-18T22:17:32.211Z","load_balancing_strategy":"primary","db_duration_s":0.005279,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2321gitlab # [ 457.649256] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:32.217Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6d3ed89dd299224344b58536","created_at":"2026-09-18T22:17:30.036Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"193f7ff1457da7980ebb26c341a1d066","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:30.077Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6d3ed89dd299224344b58536: start","job_status":"start","queue_duration_s":2.140244,"scheduling_latency_s":2.140307}2322gitlab # [ 457.666116] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:32.258Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}2323gitlab # [ 457.670391] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:32.285Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6d3ed89dd299224344b58536","created_at":"2026-09-18T22:17:30.036Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"193f7ff1457da7980ebb26c341a1d066","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:30.077Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6d3ed89dd299224344b58536: done: 0.068218 sec","job_status":"done","queue_duration_s":2.140244,"scheduling_latency_s":2.140307,"redis_calls":9,"redis_duration_s":0.005596,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001233,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003196,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001167,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041684,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.068218,"completed_at":"2026-09-18T22:17:32.285Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002043,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2324gitlab # [ 457.713644] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:32.290Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"4e5dc000b26629341b581a92","created_at":"2026-09-18T22:17:30.132Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"144138d6b133a369b2ce0e958d86e67c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:30.163Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-4e5dc000b26629341b581a92: start","job_status":"start","queue_duration_s":2.126855,"scheduling_latency_s":2.126918}2325gitlab # [ 457.791329] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:32.430Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"4e5dc000b26629341b581a92","created_at":"2026-09-18T22:17:30.132Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"144138d6b133a369b2ce0e958d86e67c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:30.163Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-4e5dc000b26629341b581a92: done: 0.140551 sec","job_status":"done","queue_duration_s":2.126855,"scheduling_latency_s":2.126918,"redis_calls":11,"redis_duration_s":0.005691,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000763,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002461,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002467,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.085653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00179174,"exclusive_lock_hold_duration_s":0.06387824,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.140551,"completed_at":"2026-09-18T22:17:32.430Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029343,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2326gitlab # [ 457.852330] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:32.434Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"fdff8de88fbd1ca1e6e01f04","created_at":"2026-09-18T22:17:30.188Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b108e3bd0a7bc290977d517835d6804","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:30.214Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-fdff8de88fbd1ca1e6e01f04: start","job_status":"start","queue_duration_s":2.21974,"scheduling_latency_s":2.219785}2327gitlab # [ 457.867987] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:32.485Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"fdff8de88fbd1ca1e6e01f04","created_at":"2026-09-18T22:17:30.188Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b108e3bd0a7bc290977d517835d6804","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:30.214Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-fdff8de88fbd1ca1e6e01f04: done: 0.051451 sec","job_status":"done","queue_duration_s":2.21974,"scheduling_latency_s":2.219785,"redis_calls":11,"redis_duration_s":0.004273,"redis_read_bytes":9,"redis_write_bytes":1459,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001686,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001885,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000702,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034787,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.051451,"completed_at":"2026-09-18T22:17:32.485Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002607,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2328gitlab # [ 457.910845] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:32.488Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"c01ae95a50528658938972f7","created_at":"2026-09-18T22:17:30.289Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9484af4c20a22b9965077ef0e56c1ea0","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:30.326Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-c01ae95a50528658938972f7: start","job_status":"start","queue_duration_s":2.162489,"scheduling_latency_s":2.162528}2329gitlab # [ 457.925541] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:32.536Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"c01ae95a50528658938972f7","created_at":"2026-09-18T22:17:30.289Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9484af4c20a22b9965077ef0e56c1ea0","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:30.326Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-c01ae95a50528658938972f7: done: 0.048032 sec","job_status":"done","queue_duration_s":2.162489,"scheduling_latency_s":2.162528,"redis_calls":11,"redis_duration_s":0.00423,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000954,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001752,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001524,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00116532,"exclusive_lock_hold_duration_s":0.00621482,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.048032,"completed_at":"2026-09-18T22:17:32.536Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003754,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2330gitlab # [ 457.970518] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:32.539Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"0a7c343398a0349d97e3c347","created_at":"2026-09-18T22:17:30.374Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:30.400Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-0a7c343398a0349d97e3c347: start","job_status":"start","queue_duration_s":2.138687,"scheduling_latency_s":2.138718}2331gitlab # [ 458.098222] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:32.737Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"0a7c343398a0349d97e3c347","created_at":"2026-09-18T22:17:30.374Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:30.400Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-0a7c343398a0349d97e3c347: done: 0.198734 sec","job_status":"done","queue_duration_s":2.138687,"scheduling_latency_s":2.138718,"redis_calls":70,"redis_duration_s":0.025698000000000002,"redis_read_bytes":118,"redis_write_bytes":42530,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.003699,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.00109,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.019581,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001328,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.168728,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.198734,"completed_at":"2026-09-18T22:17:32.737Z","load_balancing_strategy":"primary","db_duration_s":0.00412,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2332gitlab # [ 458.153499] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:32.740Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ArchiveTracesCronWorker","jid":"541a1fe4b64bcca316153404","created_at":"2026-09-18T22:17:30.432Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"02da78644d67372209e316f5fdd85c45","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f0234f524ae629146c97646d3c809b290751f669b415a8b01cafe8f68b01506d","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:30.459Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ArchiveTracesCronWorker JID-541a1fe4b64bcca316153404: start","job_status":"start","queue_duration_s":2.281217,"scheduling_latency_s":2.281308}2333gitlab # [ 458.168745] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:32.804Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ArchiveTracesCronWorker","jid":"541a1fe4b64bcca316153404","created_at":"2026-09-18T22:17:30.432Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"02da78644d67372209e316f5fdd85c45","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f0234f524ae629146c97646d3c809b290751f669b415a8b01cafe8f68b01506d","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:30.459Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ArchiveTracesCronWorker JID-541a1fe4b64bcca316153404: done: 0.063286 sec","job_status":"done","queue_duration_s":2.281217,"scheduling_latency_s":2.281308,"redis_calls":12,"redis_duration_s":0.0051979999999999995,"redis_read_bytes":11,"redis_write_bytes":1354,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000784,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":297,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002485,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001929,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":519,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03908,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00102664,"exclusive_lock_hold_duration_s":0.020588640000000002,"duration_s":0.063286,"completed_at":"2026-09-18T22:17:32.803Z","load_balancing_strategy":"primary","db_duration_s":0.00781,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2334gitlab # [ 458.211895] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:32.807Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"42a29f3a970c3b5c321ba5bf","created_at":"2026-09-18T22:17:30.480Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f1ed81c12d206623ac62573ce32d5cd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-18T22:17:30.506Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-42a29f3a970c3b5c321ba5bf: start","job_status":"start","queue_duration_s":2.30138,"scheduling_latency_s":2.30144}2335gitlab # [ 458.226015] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:32.843Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}2336gitlab # [ 458.229842] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:32.864Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"42a29f3a970c3b5c321ba5bf","created_at":"2026-09-18T22:17:30.480Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f1ed81c12d206623ac62573ce32d5cd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-18T22:17:30.506Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-42a29f3a970c3b5c321ba5bf: done: 0.056961 sec","job_status":"done","queue_duration_s":2.30138,"scheduling_latency_s":2.30144,"redis_calls":9,"redis_duration_s":0.004508,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001058,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002312,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001138,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.056961,"completed_at":"2026-09-18T22:17:32.864Z","load_balancing_strategy":"primary","db_duration_s":0.00105,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2337gitlab # [ 458.271007] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:32.867Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"d60c73b01b7fbb71a93d94db","created_at":"2026-09-18T22:17:30.540Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0a2c5be5f2195650ce569c117fb49953","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:30.574Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-d60c73b01b7fbb71a93d94db: start","job_status":"start","queue_duration_s":2.293752,"scheduling_latency_s":2.293801}2338gitlab # [ 458.285432] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:32.924Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"d60c73b01b7fbb71a93d94db","created_at":"2026-09-18T22:17:30.540Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0a2c5be5f2195650ce569c117fb49953","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:30.574Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-d60c73b01b7fbb71a93d94db: done: 0.057017 sec","job_status":"done","queue_duration_s":2.293752,"scheduling_latency_s":2.293801,"redis_calls":9,"redis_duration_s":0.0036439999999999997,"redis_read_bytes":7,"redis_write_bytes":1026,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000693,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002093,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000858,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033252,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.057017,"completed_at":"2026-09-18T22:17:32.924Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008978,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2339gitlab # [ 458.328160] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:32.928Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"68caccf7e119d6d02b206840","created_at":"2026-09-18T22:17:30.644Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7e021469dc8449fe17de6342fb6159d6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:30.675Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-68caccf7e119d6d02b206840: start","job_status":"start","queue_duration_s":2.252855,"scheduling_latency_s":2.252901}2340gitlab # [ 458.342884] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:32.952Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}2341gitlab # [ 458.346426] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:32.966Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"68caccf7e119d6d02b206840","created_at":"2026-09-18T22:17:30.644Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7e021469dc8449fe17de6342fb6159d6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:30.675Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-68caccf7e119d6d02b206840: done: 0.038857 sec","job_status":"done","queue_duration_s":2.252855,"scheduling_latency_s":2.252901,"redis_calls":9,"redis_duration_s":0.003463,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000888,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00182,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000755,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022453,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038857,"completed_at":"2026-09-18T22:17:32.966Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001053,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2342gitlab # [ 458.390895] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:32.969Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"6abe7f207f938d715791f9e3","created_at":"2026-09-18T22:17:30.719Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"687a6ed7f8d40da83aa9ccc560363a27","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:30.748Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-6abe7f207f938d715791f9e3: start","job_status":"start","queue_duration_s":2.221052,"scheduling_latency_s":2.221095}2343gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses2344gitlab # [ 458.633007] gitaly[920]: time="2026-09-18T22:17:33.272Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9HA76147VKKFVTFV78892 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T22:18:03.269" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:33.270" grpc.time_ms=1.44 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2345gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses, in 0.26 seconds)2346gitlab # [ 458.701682] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:33 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1812347gitlab # [ 458.725016] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.363Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"6abe7f207f938d715791f9e3","created_at":"2026-09-18T22:17:30.719Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"687a6ed7f8d40da83aa9ccc560363a27","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:30.748Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-6abe7f207f938d715791f9e3: done: 0.3943 sec","job_status":"done","queue_duration_s":2.221052,"scheduling_latency_s":2.221095,"redis_calls":13,"redis_duration_s":0.004576,"redis_read_bytes":11,"redis_write_bytes":1563,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001402,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001576,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001598,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.07,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.068,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.303965,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00090142,"exclusive_lock_hold_duration_s":0.35701596,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.3943,"completed_at":"2026-09-18T22:17:33.363Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.10714,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2348gitlab # [ 458.820430] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.366Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"1f863d64ab33bea256778825","created_at":"2026-09-18T22:17:30.774Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"22078d0962145e89d93bf2b9376fbef8","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:30.803Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-1f863d64ab33bea256778825: start","job_status":"start","queue_duration_s":2.563062,"scheduling_latency_s":2.563092}2349gitlab # [ 458.840580] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.419Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"1f863d64ab33bea256778825","created_at":"2026-09-18T22:17:30.774Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"22078d0962145e89d93bf2b9376fbef8","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:30.803Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-1f863d64ab33bea256778825: done: 0.053292 sec","job_status":"done","queue_duration_s":2.563062,"scheduling_latency_s":2.563092,"redis_calls":9,"redis_duration_s":0.0032300000000000002,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000662,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001855,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000713,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.053292,"completed_at":"2026-09-18T22:17:33.419Z","load_balancing_strategy":"primary","db_duration_s":0.020011,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2350gitlab # [ 458.888219] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.421Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"49dc27e2d97369c0ec414a9f","created_at":"2026-09-18T22:17:30.849Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3ea40ff669900e9a2a9dcd06c17b7c4c","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:30.891Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-49dc27e2d97369c0ec414a9f: start","job_status":"start","queue_duration_s":2.530252,"scheduling_latency_s":2.530285}2351gitlab # [ 458.932192] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.467Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"49dc27e2d97369c0ec414a9f","created_at":"2026-09-18T22:17:30.849Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3ea40ff669900e9a2a9dcd06c17b7c4c","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:30.891Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-49dc27e2d97369c0ec414a9f: done: 0.045848 sec","job_status":"done","queue_duration_s":2.530252,"scheduling_latency_s":2.530285,"redis_calls":12,"redis_duration_s":0.004209,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000633,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00189,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001686,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029761,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01291914,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.045848,"completed_at":"2026-09-18T22:17:33.467Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005546,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2352gitlab # [ 459.004605] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.470Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"a32feab7643eeb1f0a42624c","created_at":"2026-09-18T22:17:31.133Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2f4e27266ff633b8d222da2748d43bd8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-18T22:17:31.159Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-a32feab7643eeb1f0a42624c: start","job_status":"start","queue_duration_s":2.311309,"scheduling_latency_s":2.311341}2353gitlab # [ 459.032814] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.486Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}2354gitlab # [ 459.038953] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.495Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"a32feab7643eeb1f0a42624c","created_at":"2026-09-18T22:17:31.133Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2f4e27266ff633b8d222da2748d43bd8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-18T22:17:31.159Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-a32feab7643eeb1f0a42624c: done: 0.025113 sec","job_status":"done","queue_duration_s":2.311309,"scheduling_latency_s":2.311341,"redis_calls":9,"redis_duration_s":0.002493,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000544,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001352,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000597,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01423,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025113,"completed_at":"2026-09-18T22:17:33.495Z","load_balancing_strategy":"primary","db_duration_s":0.00094,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2355gitlab # [ 459.090993] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.497Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"a0f6b5608a77d22127f9f64c","created_at":"2026-09-18T22:17:31.217Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7fd3f5c11012690af60fd342079b90c8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-18T22:17:31.245Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-a0f6b5608a77d22127f9f64c: start","job_status":"start","queue_duration_s":2.2522,"scheduling_latency_s":2.252227}2356gitlab # [ 459.104305] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.534Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"a0f6b5608a77d22127f9f64c","created_at":"2026-09-18T22:17:31.217Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7fd3f5c11012690af60fd342079b90c8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-18T22:17:31.245Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-a0f6b5608a77d22127f9f64c: done: 0.036736 sec","job_status":"done","queue_duration_s":2.2522,"scheduling_latency_s":2.252227,"redis_calls":9,"redis_duration_s":0.0024,"redis_read_bytes":7,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000472,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001398,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00053,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022727,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036736,"completed_at":"2026-09-18T22:17:33.534Z","load_balancing_strategy":"primary","db_duration_s":0.006502,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2357gitlab # [ 459.147373] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.535Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"eca3553b9059e633f6e6e55d","created_at":"2026-09-18T22:17:31.275Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"be4f8a2c490ae92e3c876072eb60a0e7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:31.296Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-eca3553b9059e633f6e6e55d: start","job_status":"start","queue_duration_s":2.239111,"scheduling_latency_s":2.239133}2358gitlab # [ 459.163998] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.568Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"eca3553b9059e633f6e6e55d","created_at":"2026-09-18T22:17:31.275Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"be4f8a2c490ae92e3c876072eb60a0e7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:31.296Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-eca3553b9059e633f6e6e55d: done: 0.032707 sec","job_status":"done","queue_duration_s":2.239111,"scheduling_latency_s":2.239133,"redis_calls":11,"redis_duration_s":0.002571,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000409,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001156,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019089,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000583,"exclusive_lock_hold_duration_s":0.00994046,"duration_s":0.032707,"completed_at":"2026-09-18T22:17:33.568Z","load_balancing_strategy":"primary","db_duration_s":0.006175,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2359gitlab # [ 459.206773] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.570Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"eb24237236795854700c25ed","created_at":"2026-09-18T22:17:31.315Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"259de0982377b3067dba574ba4a8d5f5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:31.342Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-eb24237236795854700c25ed: start","job_status":"start","queue_duration_s":2.228223,"scheduling_latency_s":2.228247}2360gitlab # [ 459.222890] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.597Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}2361gitlab # [ 459.226615] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.613Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"eb24237236795854700c25ed","created_at":"2026-09-18T22:17:31.315Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"259de0982377b3067dba574ba4a8d5f5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:31.342Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-eb24237236795854700c25ed: done: 0.04286 sec","job_status":"done","queue_duration_s":2.228223,"scheduling_latency_s":2.228247,"redis_calls":9,"redis_duration_s":0.002894,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000581,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001639,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000674,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027852,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.04286,"completed_at":"2026-09-18T22:17:33.613Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001337,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2362gitlab # [ 459.267922] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.616Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"35a9986097e1fb3dc3306360","created_at":"2026-09-18T22:17:31.390Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a95cc77fa1fb70786ad168f0ca339353","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:31.414Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-35a9986097e1fb3dc3306360: start","job_status":"start","queue_duration_s":2.202236,"scheduling_latency_s":2.202278}2363gitlab # [ 459.282021] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.669Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"35a9986097e1fb3dc3306360","created_at":"2026-09-18T22:17:31.390Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a95cc77fa1fb70786ad168f0ca339353","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:31.414Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-35a9986097e1fb3dc3306360: done: 0.052669 sec","job_status":"done","queue_duration_s":2.202236,"scheduling_latency_s":2.202278,"redis_calls":9,"redis_duration_s":0.004806,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000961,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002586,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001259,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.052669,"completed_at":"2026-09-18T22:17:33.669Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005529,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2364gitlab # [ 459.323237] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.672Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"7633d71c8fbc390aadd20165","created_at":"2026-09-18T22:17:31.446Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"403cdb709903ca6210c88a08116cab58","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:31.472Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-7633d71c8fbc390aadd20165: start","job_status":"start","queue_duration_s":2.200759,"scheduling_latency_s":2.200815}2365gitlab # [ 459.337811] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.757Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"7633d71c8fbc390aadd20165","created_at":"2026-09-18T22:17:31.446Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"403cdb709903ca6210c88a08116cab58","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:31.472Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-7633d71c8fbc390aadd20165: done: 0.084576 sec","job_status":"done","queue_duration_s":2.200759,"scheduling_latency_s":2.200815,"redis_calls":11,"redis_duration_s":0.004262,"redis_read_bytes":9,"redis_write_bytes":1509,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000748,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001771,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001743,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046961,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00105836,"exclusive_lock_hold_duration_s":0.03992572,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.084576,"completed_at":"2026-09-18T22:17:33.757Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021274,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2366gitlab # [ 459.381634] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.760Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"4b15db7c4490d493e948c7c4","created_at":"2026-09-18T22:17:31.495Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4b0cd2c3b0cf0867351c350697befeb8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:31.523Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-4b15db7c4490d493e948c7c4: start","job_status":"start","queue_duration_s":2.236531,"scheduling_latency_s":2.236564}2367gitlab # [ 459.396004] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.785Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}2368gitlab # [ 459.399112] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.801Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"4b15db7c4490d493e948c7c4","created_at":"2026-09-18T22:17:31.495Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4b0cd2c3b0cf0867351c350697befeb8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:31.523Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-4b15db7c4490d493e948c7c4: done: 0.041565 sec","job_status":"done","queue_duration_s":2.236531,"scheduling_latency_s":2.236564,"redis_calls":9,"redis_duration_s":0.0046099999999999995,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000909,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002842,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000859,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022294,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041565,"completed_at":"2026-09-18T22:17:33.801Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001097,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2369gitlab # [ 459.442485] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.804Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"d535ae920ea00e4ebb1a8fab","created_at":"2026-09-18T22:17:31.563Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"190e838f8b7afe3b2d809720fda81ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:31.592Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-d535ae920ea00e4ebb1a8fab: start","job_status":"start","queue_duration_s":2.211387,"scheduling_latency_s":2.211419}2370gitlab # [ 459.456989] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.838Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"d535ae920ea00e4ebb1a8fab","created_at":"2026-09-18T22:17:31.563Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-deb1d96cd58b4c5a","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"190e838f8b7afe3b2d809720fda81ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:31.592Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-d535ae920ea00e4ebb1a8fab: done: 0.034674 sec","job_status":"done","queue_duration_s":2.211387,"scheduling_latency_s":2.211419,"redis_calls":9,"redis_duration_s":0.002996,"redis_read_bytes":7,"redis_write_bytes":1119,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000642,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001696,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000658,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019771,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034674,"completed_at":"2026-09-18T22:17:33.838Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001052,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2371gitlab # [ 459.499549] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.842Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4a4ab64fa3b6cc677c70db1e","created_at":"2026-09-18T22:17:32.135Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-43204d85b52a40b5","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"34be4823274a6fb1be86fec3ecaf1fce","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.178Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4a4ab64fa3b6cc677c70db1e: start","job_status":"start","queue_duration_s":1.663981,"scheduling_latency_s":1.664011}2372gitlab # [ 459.511838] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.868Z","message":"No existing merge request to be cleaned up."}2373gitlab # [ 459.514046] nix-daemon[3814]: accepted connection from pid 4947, user nixbot2374gitlab # [ 459.514995] nix-daemon[3814]: accepted connection from pid 4910, user nixbot2375gitlab # [ 459.515957] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.891Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4a4ab64fa3b6cc677c70db1e","created_at":"2026-09-18T22:17:32.135Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-43204d85b52a40b5","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"34be4823274a6fb1be86fec3ecaf1fce","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.178Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4a4ab64fa3b6cc677c70db1e: done: 0.049148 sec","job_status":"done","queue_duration_s":1.663981,"scheduling_latency_s":1.664011,"redis_calls":12,"redis_duration_s":0.004484,"redis_read_bytes":10,"redis_write_bytes":1323,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000658,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001333,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002493,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028619,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.049148,"completed_at":"2026-09-18T22:17:33.891Z","load_balancing_strategy":"primary","db_duration_s":0.006753,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2376gitlab # [ 459.555935] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.892Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7e34d5c642feff8f10cd88b7","created_at":"2026-09-18T22:17:32.135Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-43204d85b52a40b5","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"34be4823274a6fb1be86fec3ecaf1fce","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.178Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7e34d5c642feff8f10cd88b7: start","job_status":"start","queue_duration_s":1.714737,"scheduling_latency_s":1.714776}2377gitlab # [ 459.568329] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.911Z","message":"No existing merge request to be cleaned up."}2378gitlab # [ 459.569952] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.922Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7e34d5c642feff8f10cd88b7","created_at":"2026-09-18T22:17:32.135Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-43204d85b52a40b5","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"34be4823274a6fb1be86fec3ecaf1fce","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.178Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7e34d5c642feff8f10cd88b7: done: 0.029853 sec","job_status":"done","queue_duration_s":1.714737,"scheduling_latency_s":1.714776,"redis_calls":10,"redis_duration_s":0.005246000000000001,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002478,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002768,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018331,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029853,"completed_at":"2026-09-18T22:17:33.922Z","load_balancing_strategy":"primary","db_duration_s":0.003186,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2379gitlab # [ 459.607862] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.925Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"fa3187ba521f00be796f4078","created_at":"2026-09-18T22:17:32.135Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-43204d85b52a40b5","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"34be4823274a6fb1be86fec3ecaf1fce","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.178Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-fa3187ba521f00be796f4078: start","job_status":"start","queue_duration_s":1.747208,"scheduling_latency_s":1.747233}2380gitlab # [ 459.620167] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.940Z","message":"No existing merge request to be cleaned up."}2381gitlab # [ 459.623065] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.952Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"fa3187ba521f00be796f4078","created_at":"2026-09-18T22:17:32.135Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-43204d85b52a40b5","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"34be4823274a6fb1be86fec3ecaf1fce","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.178Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-fa3187ba521f00be796f4078: done: 0.026754 sec","job_status":"done","queue_duration_s":1.747208,"scheduling_latency_s":1.747233,"redis_calls":10,"redis_duration_s":0.003014,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001459,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001555,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017796,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026754,"completed_at":"2026-09-18T22:17:33.951Z","load_balancing_strategy":"primary","db_duration_s":0.002926,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2382gitlab # [ 459.661010] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.955Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7d1875dd555bce30e0aca0be","created_at":"2026-09-18T22:17:32.135Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-43204d85b52a40b5","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"34be4823274a6fb1be86fec3ecaf1fce","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.178Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7d1875dd555bce30e0aca0be: start","job_status":"start","queue_duration_s":1.776991,"scheduling_latency_s":1.777017}2383gitlab # [ 459.673150] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.975Z","message":"No existing merge request to be cleaned up."}2384gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses2385gitlab # [ 459.674773] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.987Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7d1875dd555bce30e0aca0be","created_at":"2026-09-18T22:17:32.135Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-43204d85b52a40b5","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"34be4823274a6fb1be86fec3ecaf1fce","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.178Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7d1875dd555bce30e0aca0be: done: 0.032864 sec","job_status":"done","queue_duration_s":1.776991,"scheduling_latency_s":1.777017,"redis_calls":10,"redis_duration_s":0.0035470000000000002,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00206,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019188,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032864,"completed_at":"2026-09-18T22:17:33.987Z","load_balancing_strategy":"primary","db_duration_s":0.010475,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2386gitlab # [ 459.712107] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:33.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e65e371b26ca2c60594bc1f","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e65e371b26ca2c60594bc1f: start","job_status":"start","queue_duration_s":1.274086,"scheduling_latency_s":1.274114}2387gitlab # [ 459.723327] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.027Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e65e371b26ca2c60594bc1f","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e65e371b26ca2c60594bc1f: done: 0.036712 sec","job_status":"done","queue_duration_s":1.274086,"scheduling_latency_s":1.274114,"redis_calls":15,"redis_duration_s":0.006026,"redis_read_bytes":12,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000631,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00181,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003585,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021571,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036712,"completed_at":"2026-09-18T22:17:34.027Z","load_balancing_strategy":"primary","db_duration_s":0.001041,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2388gitlab # [ 459.762400] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05e7954c801220ca38928815","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05e7954c801220ca38928815: start","job_status":"start","queue_duration_s":1.312564,"scheduling_latency_s":1.312588}2389gitlab # [ 459.774688] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.048Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05e7954c801220ca38928815","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05e7954c801220ca38928815: done: 0.018903 sec","job_status":"done","queue_duration_s":1.312564,"scheduling_latency_s":1.312588,"redis_calls":13,"redis_duration_s":0.003189,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001147,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002042,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018903,"completed_at":"2026-09-18T22:17:34.047Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2390gitlab # [ 459.812802] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.049Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea724b0a6301fdab4734b255","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea724b0a6301fdab4734b255: start","job_status":"start","queue_duration_s":1.333041,"scheduling_latency_s":1.333063}2391gitlab # [ 459.826161] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea724b0a6301fdab4734b255","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea724b0a6301fdab4734b255: done: 0.018923 sec","job_status":"done","queue_duration_s":1.333041,"scheduling_latency_s":1.333063,"redis_calls":13,"redis_duration_s":0.002119,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000767,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001352,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012257,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018923,"completed_at":"2026-09-18T22:17:34.068Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2392gitlab # [ 459.864657] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.070Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92733751a48db7f71b00e4b1","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92733751a48db7f71b00e4b1: start","job_status":"start","queue_duration_s":1.353448,"scheduling_latency_s":1.353469}2393gitlab # [ 459.876838] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.087Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92733751a48db7f71b00e4b1","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92733751a48db7f71b00e4b1: done: 0.017686 sec","job_status":"done","queue_duration_s":1.353448,"scheduling_latency_s":1.353469,"redis_calls":13,"redis_duration_s":0.002491,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000724,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001767,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017686,"completed_at":"2026-09-18T22:17:34.087Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2394gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses, in 0.21 seconds)2395gitlab # [ 459.915351] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.089Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d49c2546c135e5588206c9aa","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d49c2546c135e5588206c9aa: start","job_status":"start","queue_duration_s":1.372468,"scheduling_latency_s":1.37249}2396gitlab # [ 459.927596] gitaly[920]: time="2026-09-18T22:17:34.502Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9HBE5JAWW23XP920JBA3H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T22:18:04.500" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:34.500" grpc.time_ms=1.26 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2397gitlab # [ 459.940677] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:34 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1412398gitlab # [ 459.943170] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d49c2546c135e5588206c9aa","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d49c2546c135e5588206c9aa: done: 0.017151 sec","job_status":"done","queue_duration_s":1.372468,"scheduling_latency_s":1.37249,"redis_calls":13,"redis_duration_s":0.001807,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00069,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001117,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011256,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017151,"completed_at":"2026-09-18T22:17:34.106Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2399gitlab # [ 459.981643] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.112Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f21f93eaad98ff367e8b8227","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f21f93eaad98ff367e8b8227: start","job_status":"start","queue_duration_s":1.395432,"scheduling_latency_s":1.395461}2400gitlab # [ 459.993933] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.131Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f21f93eaad98ff367e8b8227","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f21f93eaad98ff367e8b8227: done: 0.019683 sec","job_status":"done","queue_duration_s":1.395432,"scheduling_latency_s":1.395461,"redis_calls":13,"redis_duration_s":0.0021060000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000773,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001333,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019683,"completed_at":"2026-09-18T22:17:34.131Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2401gitlab # [ 460.034295] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.133Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"725d925647d4e8adde53830b","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-725d925647d4e8adde53830b: start","job_status":"start","queue_duration_s":1.417078,"scheduling_latency_s":1.417104}2402gitlab # [ 460.046865] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.153Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"725d925647d4e8adde53830b","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-725d925647d4e8adde53830b: done: 0.020161 sec","job_status":"done","queue_duration_s":1.417078,"scheduling_latency_s":1.417104,"redis_calls":13,"redis_duration_s":0.002379,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000846,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001533,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020161,"completed_at":"2026-09-18T22:17:34.153Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2403gitlab # [ 460.086091] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fddf4cb0e77e63d71c2b9472","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fddf4cb0e77e63d71c2b9472: start","job_status":"start","queue_duration_s":1.439438,"scheduling_latency_s":1.439469}2404gitlab # [ 460.098723] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.177Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fddf4cb0e77e63d71c2b9472","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fddf4cb0e77e63d71c2b9472: done: 0.021627 sec","job_status":"done","queue_duration_s":1.439438,"scheduling_latency_s":1.439469,"redis_calls":13,"redis_duration_s":0.0039559999999999994,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001189,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002767,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013705,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021627,"completed_at":"2026-09-18T22:17:34.177Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2405gitlab # [ 460.138641] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.180Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e68d8f5037ceff3d89126602","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e68d8f5037ceff3d89126602: start","job_status":"start","queue_duration_s":1.463627,"scheduling_latency_s":1.463653}2406gitlab # [ 460.151205] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e68d8f5037ceff3d89126602","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e68d8f5037ceff3d89126602: done: 0.021187 sec","job_status":"done","queue_duration_s":1.463627,"scheduling_latency_s":1.463653,"redis_calls":13,"redis_duration_s":0.003587,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001208,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002379,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013669,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021187,"completed_at":"2026-09-18T22:17:34.201Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2407gitlab # [ 460.190992] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.203Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f6b73518a284f568b8c9158","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f6b73518a284f568b8c9158: start","job_status":"start","queue_duration_s":1.486845,"scheduling_latency_s":1.486866}2408gitlab # [ 460.203746] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.220Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f6b73518a284f568b8c9158","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f6b73518a284f568b8c9158: done: 0.016923 sec","job_status":"done","queue_duration_s":1.486845,"scheduling_latency_s":1.486866,"redis_calls":13,"redis_duration_s":0.0028190000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001881,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010731,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016923,"completed_at":"2026-09-18T22:17:34.220Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2409gitlab # [ 460.245456] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.221Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81664a12cd6ff7ff046f4c7f","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81664a12cd6ff7ff046f4c7f: start","job_status":"start","queue_duration_s":1.505223,"scheduling_latency_s":1.50524}2410gitlab # [ 460.258111] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.237Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81664a12cd6ff7ff046f4c7f","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81664a12cd6ff7ff046f4c7f: done: 0.015556 sec","job_status":"done","queue_duration_s":1.505223,"scheduling_latency_s":1.50524,"redis_calls":13,"redis_duration_s":0.0027990000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001863,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009589,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015556,"completed_at":"2026-09-18T22:17:34.237Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2411gitlab # [ 460.297830] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.238Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41caa4bc4d7b6b0833e25597","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41caa4bc4d7b6b0833e25597: start","job_status":"start","queue_duration_s":1.522353,"scheduling_latency_s":1.522368}2412gitlab # [ 460.310566] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.254Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41caa4bc4d7b6b0833e25597","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41caa4bc4d7b6b0833e25597: done: 0.01552 sec","job_status":"done","queue_duration_s":1.522353,"scheduling_latency_s":1.522368,"redis_calls":13,"redis_duration_s":0.002898,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00099,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001908,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01552,"completed_at":"2026-09-18T22:17:34.254Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2413gitlab # [ 460.350314] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.257Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c397f3289dc5e8bc2485637","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c397f3289dc5e8bc2485637: start","job_status":"start","queue_duration_s":1.540709,"scheduling_latency_s":1.540755}2414gitlab # [ 460.362880] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c397f3289dc5e8bc2485637","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c397f3289dc5e8bc2485637: done: 0.042455 sec","job_status":"done","queue_duration_s":1.540709,"scheduling_latency_s":1.540755,"redis_calls":13,"redis_duration_s":0.005299,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001871,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003428,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.042455,"completed_at":"2026-09-18T22:17:34.299Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2415gitlab # [ 460.403167] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.303Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e01db7a60fce46f8c3e247d","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e01db7a60fce46f8c3e247d: start","job_status":"start","queue_duration_s":1.586672,"scheduling_latency_s":1.586716}2416gitlab # [ 460.415735] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e01db7a60fce46f8c3e247d","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e01db7a60fce46f8c3e247d: done: 0.034439 sec","job_status":"done","queue_duration_s":1.586672,"scheduling_latency_s":1.586716,"redis_calls":13,"redis_duration_s":0.004242,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001446,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002796,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034439,"completed_at":"2026-09-18T22:17:34.337Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2417gitlab # [ 460.457001] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.340Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf0d2c4c5d1cf31a8e15c0e0","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf0d2c4c5d1cf31a8e15c0e0: start","job_status":"start","queue_duration_s":1.62351,"scheduling_latency_s":1.623547}2418gitlab # [ 460.469579] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.366Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf0d2c4c5d1cf31a8e15c0e0","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf0d2c4c5d1cf31a8e15c0e0: done: 0.026834 sec","job_status":"done","queue_duration_s":1.62351,"scheduling_latency_s":1.623547,"redis_calls":13,"redis_duration_s":0.003894,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001272,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002622,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026834,"completed_at":"2026-09-18T22:17:34.366Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2419gitlab # [ 460.509455] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.368Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c2f4fc688fe1a60c43ba299","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c2f4fc688fe1a60c43ba299: start","job_status":"start","queue_duration_s":1.6521,"scheduling_latency_s":1.652128}2420gitlab # [ 460.521994] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.392Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c2f4fc688fe1a60c43ba299","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c2f4fc688fe1a60c43ba299: done: 0.023615 sec","job_status":"done","queue_duration_s":1.6521,"scheduling_latency_s":1.652128,"redis_calls":13,"redis_duration_s":0.0036810000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001159,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002522,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023615,"completed_at":"2026-09-18T22:17:34.392Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2421gitlab # [ 460.562145] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.397Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b49a1c959c85dc905eb6951","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b49a1c959c85dc905eb6951: start","job_status":"start","queue_duration_s":1.680605,"scheduling_latency_s":1.68065}2422gitlab # [ 460.575128] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.428Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b49a1c959c85dc905eb6951","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b49a1c959c85dc905eb6951: done: 0.031115 sec","job_status":"done","queue_duration_s":1.680605,"scheduling_latency_s":1.68065,"redis_calls":13,"redis_duration_s":0.0044729999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001412,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003061,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031115,"completed_at":"2026-09-18T22:17:34.428Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2423gitlab # [ 460.615726] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.430Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"560f08cb37fcf530422a529e","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-560f08cb37fcf530422a529e: start","job_status":"start","queue_duration_s":1.713614,"scheduling_latency_s":1.713637}2424gitlab # [ 460.628495] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.452Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"560f08cb37fcf530422a529e","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-560f08cb37fcf530422a529e: done: 0.022302 sec","job_status":"done","queue_duration_s":1.713614,"scheduling_latency_s":1.713637,"redis_calls":13,"redis_duration_s":0.003418,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001238,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00218,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01411,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022302,"completed_at":"2026-09-18T22:17:34.452Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2425gitlab # [ 460.670674] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.454Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2dc5dfbbcd5089e460003721","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2dc5dfbbcd5089e460003721: start","job_status":"start","queue_duration_s":1.737944,"scheduling_latency_s":1.73797}2426gitlab # [ 460.683440] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.477Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2dc5dfbbcd5089e460003721","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2dc5dfbbcd5089e460003721: done: 0.022759 sec","job_status":"done","queue_duration_s":1.737944,"scheduling_latency_s":1.73797,"redis_calls":13,"redis_duration_s":0.003386,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001188,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002198,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014356,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022759,"completed_at":"2026-09-18T22:17:34.477Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2427gitlab # [ 460.723605] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.480Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"733956f290911de1374c7a44","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-733956f290911de1374c7a44: start","job_status":"start","queue_duration_s":1.763528,"scheduling_latency_s":1.763561}2428gitlab # [ 460.736582] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"733956f290911de1374c7a44","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-733956f290911de1374c7a44: done: 0.018221 sec","job_status":"done","queue_duration_s":1.763528,"scheduling_latency_s":1.763561,"redis_calls":13,"redis_duration_s":0.002469,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000878,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001591,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010796,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018221,"completed_at":"2026-09-18T22:17:34.498Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2429gitlab # [ 460.776519] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.499Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4e777e4b7f9098d42914695","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4e777e4b7f9098d42914695: start","job_status":"start","queue_duration_s":1.783026,"scheduling_latency_s":1.783046}2430gitlab # [ 460.789117] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.514Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4e777e4b7f9098d42914695","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4e777e4b7f9098d42914695: done: 0.015221 sec","job_status":"done","queue_duration_s":1.783026,"scheduling_latency_s":1.783046,"redis_calls":13,"redis_duration_s":0.001507,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010213,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015221,"completed_at":"2026-09-18T22:17:34.514Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2431gitlab # [ 460.828467] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.516Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"898e6fb199d015d17838f194","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-898e6fb199d015d17838f194: start","job_status":"start","queue_duration_s":1.799598,"scheduling_latency_s":1.799619}2432gitlab # [ 460.840987] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.532Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"898e6fb199d015d17838f194","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-898e6fb199d015d17838f194: done: 0.016173 sec","job_status":"done","queue_duration_s":1.799598,"scheduling_latency_s":1.799619,"redis_calls":13,"redis_duration_s":0.001964,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000575,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001389,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010906,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016173,"completed_at":"2026-09-18T22:17:34.532Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2433gitlab # [ 460.882372] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.533Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31d63a59b8175b0d10308209","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31d63a59b8175b0d10308209: start","job_status":"start","queue_duration_s":1.8172,"scheduling_latency_s":1.817224}2434gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses2435gitlab # [ 460.895234] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.550Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31d63a59b8175b0d10308209","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31d63a59b8175b0d10308209: done: 0.016353 sec","job_status":"done","queue_duration_s":1.8172,"scheduling_latency_s":1.817224,"redis_calls":13,"redis_duration_s":0.001703,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000617,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001086,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016353,"completed_at":"2026-09-18T22:17:34.550Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2436gitlab # [ 460.933647] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.551Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03d38e5af093d236629105cb","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03d38e5af093d236629105cb: start","job_status":"start","queue_duration_s":1.835024,"scheduling_latency_s":1.835047}2437gitlab # [ 460.945265] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.571Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03d38e5af093d236629105cb","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03d38e5af093d236629105cb: done: 0.019531 sec","job_status":"done","queue_duration_s":1.835024,"scheduling_latency_s":1.835047,"redis_calls":13,"redis_duration_s":0.002182,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000815,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001367,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013192,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019531,"completed_at":"2026-09-18T22:17:34.571Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2438gitlab # [ 460.983265] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.572Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c672c23a91b3bd287d20a00b","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c672c23a91b3bd287d20a00b: start","job_status":"start","queue_duration_s":1.856245,"scheduling_latency_s":1.856321}2439gitlab # [ 460.996023] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c672c23a91b3bd287d20a00b","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c672c23a91b3bd287d20a00b: done: 0.017267 sec","job_status":"done","queue_duration_s":1.856245,"scheduling_latency_s":1.856321,"redis_calls":13,"redis_duration_s":0.00181,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000841,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000969,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017267,"completed_at":"2026-09-18T22:17:34.589Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2440gitlab # [ 461.035600] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.591Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f82f19d6fe234971e3cef81","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f82f19d6fe234971e3cef81: start","job_status":"start","queue_duration_s":1.87462,"scheduling_latency_s":1.874637}2441gitlab # [ 461.048617] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.607Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f82f19d6fe234971e3cef81","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f82f19d6fe234971e3cef81: done: 0.016183 sec","job_status":"done","queue_duration_s":1.87462,"scheduling_latency_s":1.874637,"redis_calls":13,"redis_duration_s":0.002901,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009999,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016183,"completed_at":"2026-09-18T22:17:34.607Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2442gitlab # [ 461.089454] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.609Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00d1a6b85e9cea4e38acb500","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00d1a6b85e9cea4e38acb500: start","job_status":"start","queue_duration_s":1.892664,"scheduling_latency_s":1.892683}2443gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses, in 0.22 seconds)2444gitlab # [ 461.101851] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.625Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00d1a6b85e9cea4e38acb500","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00d1a6b85e9cea4e38acb500: done: 0.016553 sec","job_status":"done","queue_duration_s":1.892664,"scheduling_latency_s":1.892683,"redis_calls":13,"redis_duration_s":0.002946,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000996,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00195,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010163,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016553,"completed_at":"2026-09-18T22:17:34.625Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2445gitlab # [ 461.140544] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.627Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8930162e15a53bfa8a69b72","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8930162e15a53bfa8a69b72: start","job_status":"start","queue_duration_s":1.910732,"scheduling_latency_s":1.910748}2446gitlab # [ 461.153303] gitaly[920]: time="2026-09-18T22:17:35.722Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9HCMZZFCV2FCZ799JCCY3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T22:18:05.420" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:35.721" grpc.time_ms=1.053 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2447gitlab # [ 461.166594] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:35 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1172448gitlab # [ 461.169318] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.643Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8930162e15a53bfa8a69b72","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8930162e15a53bfa8a69b72: done: 0.016648 sec","job_status":"done","queue_duration_s":1.910732,"scheduling_latency_s":1.910748,"redis_calls":13,"redis_duration_s":0.002955,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001027,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001928,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016648,"completed_at":"2026-09-18T22:17:34.643Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2449gitlab # [ 461.208751] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.645Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e991d6455c53bf4d16da5799","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e991d6455c53bf4d16da5799: start","job_status":"start","queue_duration_s":1.929046,"scheduling_latency_s":1.929063}2450gitlab # [ 461.221176] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.662Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e991d6455c53bf4d16da5799","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e991d6455c53bf4d16da5799: done: 0.017283 sec","job_status":"done","queue_duration_s":1.929046,"scheduling_latency_s":1.929063,"redis_calls":13,"redis_duration_s":0.0033689999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001292,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002077,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010571,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017283,"completed_at":"2026-09-18T22:17:34.662Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2451gitlab # [ 461.260682] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.664Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9d799fae987aeec556d8ae7","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9d799fae987aeec556d8ae7: start","job_status":"start","queue_duration_s":1.947869,"scheduling_latency_s":1.947886}2452gitlab # [ 461.273210] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.680Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9d799fae987aeec556d8ae7","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9d799fae987aeec556d8ae7: done: 0.016418 sec","job_status":"done","queue_duration_s":1.947869,"scheduling_latency_s":1.947886,"redis_calls":13,"redis_duration_s":0.002914,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016418,"completed_at":"2026-09-18T22:17:34.680Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2453gitlab # [ 461.314749] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.682Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"235d699019845cfe6e9a0865","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-235d699019845cfe6e9a0865: start","job_status":"start","queue_duration_s":1.96573,"scheduling_latency_s":1.965745}2454gitlab # [ 461.327350] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.698Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"235d699019845cfe6e9a0865","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-235d699019845cfe6e9a0865: done: 0.016212 sec","job_status":"done","queue_duration_s":1.96573,"scheduling_latency_s":1.965745,"redis_calls":13,"redis_duration_s":0.002833,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010069,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016212,"completed_at":"2026-09-18T22:17:34.698Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2455gitlab # [ 461.367338] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.700Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"613663e2293f4afb8f3dcd84","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-613663e2293f4afb8f3dcd84: start","job_status":"start","queue_duration_s":1.983479,"scheduling_latency_s":1.983497}2456gitlab # [ 461.380150] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.716Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"613663e2293f4afb8f3dcd84","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-613663e2293f4afb8f3dcd84: done: 0.016874 sec","job_status":"done","queue_duration_s":1.983479,"scheduling_latency_s":1.983497,"redis_calls":13,"redis_duration_s":0.003257,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001022,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002235,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010203,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016874,"completed_at":"2026-09-18T22:17:34.716Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2457gitlab # [ 461.420378] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.718Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"314d9dde5e7aa950980af956","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-314d9dde5e7aa950980af956: start","job_status":"start","queue_duration_s":2.001919,"scheduling_latency_s":2.001934}2458gitlab # [ 461.432658] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.735Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"314d9dde5e7aa950980af956","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-314d9dde5e7aa950980af956: done: 0.016897 sec","job_status":"done","queue_duration_s":2.001919,"scheduling_latency_s":2.001934,"redis_calls":13,"redis_duration_s":0.002931,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001073,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001858,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010571,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016897,"completed_at":"2026-09-18T22:17:34.735Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2459gitlab # [ 461.471721] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.737Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74919ea3856bed4f40bb530d","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74919ea3856bed4f40bb530d: start","job_status":"start","queue_duration_s":2.020423,"scheduling_latency_s":2.020441}2460gitlab # [ 461.484373] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.753Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74919ea3856bed4f40bb530d","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74919ea3856bed4f40bb530d: done: 0.016686 sec","job_status":"done","queue_duration_s":2.020423,"scheduling_latency_s":2.020441,"redis_calls":13,"redis_duration_s":0.0029509999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001004,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001947,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010257,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016686,"completed_at":"2026-09-18T22:17:34.753Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2461gitlab # [ 461.525657] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.755Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f81f33297e5f66b99456380a","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f81f33297e5f66b99456380a: start","job_status":"start","queue_duration_s":2.038584,"scheduling_latency_s":2.038607}2462gitlab # [ 461.538143] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.774Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f81f33297e5f66b99456380a","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f81f33297e5f66b99456380a: done: 0.019088 sec","job_status":"done","queue_duration_s":2.038584,"scheduling_latency_s":2.038607,"redis_calls":13,"redis_duration_s":0.0057799999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000965,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004815,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010114,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019088,"completed_at":"2026-09-18T22:17:34.774Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2463gitlab # [ 461.577673] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.775Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab48d556702bb5a92d6a0922","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab48d556702bb5a92d6a0922: start","job_status":"start","queue_duration_s":2.059261,"scheduling_latency_s":2.059282}2464gitlab # [ 461.590114] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.797Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab48d556702bb5a92d6a0922","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab48d556702bb5a92d6a0922: done: 0.021356 sec","job_status":"done","queue_duration_s":2.059261,"scheduling_latency_s":2.059282,"redis_calls":13,"redis_duration_s":0.003981,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001855,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002126,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021356,"completed_at":"2026-09-18T22:17:34.797Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2465gitlab # [ 461.629406] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.799Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36d81291ed6ad599804fe24a","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36d81291ed6ad599804fe24a: start","job_status":"start","queue_duration_s":2.082625,"scheduling_latency_s":2.082654}2466gitlab # [ 461.641875] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.821Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36d81291ed6ad599804fe24a","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36d81291ed6ad599804fe24a: done: 0.022506 sec","job_status":"done","queue_duration_s":2.082625,"scheduling_latency_s":2.082654,"redis_calls":13,"redis_duration_s":0.003263,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001117,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002146,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013849,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022506,"completed_at":"2026-09-18T22:17:34.821Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2467gitlab # [ 461.681337] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.823Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fde56328b32a62dbccb97201","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fde56328b32a62dbccb97201: start","job_status":"start","queue_duration_s":2.107046,"scheduling_latency_s":2.107071}2468gitlab # [ 461.693466] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fde56328b32a62dbccb97201","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fde56328b32a62dbccb97201: done: 0.022654 sec","job_status":"done","queue_duration_s":2.107046,"scheduling_latency_s":2.107071,"redis_calls":13,"redis_duration_s":0.00332,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001153,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002167,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022654,"completed_at":"2026-09-18T22:17:34.846Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2469gitlab # [ 461.734357] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.848Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ce8e411900276a9ca40385a","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ce8e411900276a9ca40385a: start","job_status":"start","queue_duration_s":2.131588,"scheduling_latency_s":2.131613}2470gitlab # [ 461.747588] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.870Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ce8e411900276a9ca40385a","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ce8e411900276a9ca40385a: done: 0.022755 sec","job_status":"done","queue_duration_s":2.131588,"scheduling_latency_s":2.131613,"redis_calls":13,"redis_duration_s":0.003389,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001117,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002272,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014155,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022755,"completed_at":"2026-09-18T22:17:34.870Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2471gitlab # [ 461.787862] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.872Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3534c0f167e3d9231da7a1f4","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3534c0f167e3d9231da7a1f4: start","job_status":"start","queue_duration_s":2.156223,"scheduling_latency_s":2.156247}2472gitlab # [ 461.800725] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.895Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3534c0f167e3d9231da7a1f4","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3534c0f167e3d9231da7a1f4: done: 0.022732 sec","job_status":"done","queue_duration_s":2.156223,"scheduling_latency_s":2.156247,"redis_calls":13,"redis_duration_s":0.003508,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00116,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002348,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014159,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022732,"completed_at":"2026-09-18T22:17:34.895Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2473gitlab # [ 461.841278] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba66ab83305e7b489230e845","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba66ab83305e7b489230e845: start","job_status":"start","queue_duration_s":2.180869,"scheduling_latency_s":2.180894}2474gitlab # [ 461.853783] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.919Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba66ab83305e7b489230e845","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba66ab83305e7b489230e845: done: 0.022098 sec","job_status":"done","queue_duration_s":2.180869,"scheduling_latency_s":2.180894,"redis_calls":13,"redis_duration_s":0.003208,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001117,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01385,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022098,"completed_at":"2026-09-18T22:17:34.919Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2475gitlab # [ 461.892841] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.921Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8bd15e7927be640b1aa119ab","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8bd15e7927be640b1aa119ab: start","job_status":"start","queue_duration_s":2.204871,"scheduling_latency_s":2.204892}2476gitlab # [ 461.907073] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.944Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8bd15e7927be640b1aa119ab","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8bd15e7927be640b1aa119ab: done: 0.02265 sec","job_status":"done","queue_duration_s":2.204871,"scheduling_latency_s":2.204892,"redis_calls":13,"redis_duration_s":0.003315,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001156,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002159,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02265,"completed_at":"2026-09-18T22:17:34.944Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2477gitlab # [ 461.946187] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.946Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f66a6e328fbac966cecabc0a","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f66a6e328fbac966cecabc0a: start","job_status":"start","queue_duration_s":2.22952,"scheduling_latency_s":2.229545}2478gitlab # [ 461.958772] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.969Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f66a6e328fbac966cecabc0a","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f66a6e328fbac966cecabc0a: done: 0.02305 sec","job_status":"done","queue_duration_s":2.22952,"scheduling_latency_s":2.229545,"redis_calls":13,"redis_duration_s":0.003391,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00121,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002181,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02305,"completed_at":"2026-09-18T22:17:34.969Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2479gitlab # [ 461.997813] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.971Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5e1f7f6093ad8b957b01a5f","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5e1f7f6093ad8b957b01a5f: start","job_status":"start","queue_duration_s":2.254403,"scheduling_latency_s":2.254428}2480gitlab # [ 462.010536] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.994Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5e1f7f6093ad8b957b01a5f","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5e1f7f6093ad8b957b01a5f: done: 0.023658 sec","job_status":"done","queue_duration_s":2.254403,"scheduling_latency_s":2.254428,"redis_calls":13,"redis_duration_s":0.004073,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001127,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002946,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023658,"completed_at":"2026-09-18T22:17:34.994Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2481gitlab # [ 462.049982] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:34.996Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"842dd4646a25c18a45905e53","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-842dd4646a25c18a45905e53: start","job_status":"start","queue_duration_s":2.280029,"scheduling_latency_s":2.280054}2482gitlab # [ 462.062598] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:35.019Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"842dd4646a25c18a45905e53","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-842dd4646a25c18a45905e53: done: 0.02315 sec","job_status":"done","queue_duration_s":2.280029,"scheduling_latency_s":2.280054,"redis_calls":13,"redis_duration_s":0.0033949999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001122,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002273,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014419,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02315,"completed_at":"2026-09-18T22:17:35.019Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2483gitlab # [ 462.101995] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:35.021Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffa4e3cd7439e3d9b67faae4","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffa4e3cd7439e3d9b67faae4: start","job_status":"start","queue_duration_s":2.305178,"scheduling_latency_s":2.305204}2484gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses2485gitlab # [ 462.116169] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:35.047Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffa4e3cd7439e3d9b67faae4","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffa4e3cd7439e3d9b67faae4: done: 0.025666 sec","job_status":"done","queue_duration_s":2.305178,"scheduling_latency_s":2.305204,"redis_calls":13,"redis_duration_s":0.0034400000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001148,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002292,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014344,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025666,"completed_at":"2026-09-18T22:17:35.047Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2486gitlab # [ 462.154847] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:35.051Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb45b364ece5b2cf46cb9f9d","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb45b364ece5b2cf46cb9f9d: start","job_status":"start","queue_duration_s":2.334698,"scheduling_latency_s":2.334755}2487gitlab # [ 462.167340] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:35.100Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb45b364ece5b2cf46cb9f9d","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb45b364ece5b2cf46cb9f9d: done: 0.04924 sec","job_status":"done","queue_duration_s":2.334698,"scheduling_latency_s":2.334755,"redis_calls":13,"redis_duration_s":0.005097,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001651,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003446,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034102,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.04924,"completed_at":"2026-09-18T22:17:35.100Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2488gitlab # [ 462.206957] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:35.103Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9081fefc4b56213305d3f243","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9081fefc4b56213305d3f243: start","job_status":"start","queue_duration_s":2.387111,"scheduling_latency_s":2.387155}2489gitlab # [ 462.219357] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:35.138Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9081fefc4b56213305d3f243","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9081fefc4b56213305d3f243: done: 0.034649 sec","job_status":"done","queue_duration_s":2.387111,"scheduling_latency_s":2.387155,"redis_calls":13,"redis_duration_s":0.004109,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001634,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002475,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034649,"completed_at":"2026-09-18T22:17:35.138Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2490gitlab # [ 462.258953] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:35.141Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a0e9039754920d253f0da5c","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a0e9039754920d253f0da5c: start","job_status":"start","queue_duration_s":2.424741,"scheduling_latency_s":2.424779}2491gitlab # [ 462.271532] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:35.175Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a0e9039754920d253f0da5c","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a0e9039754920d253f0da5c: done: 0.034075 sec","job_status":"done","queue_duration_s":2.424741,"scheduling_latency_s":2.424779,"redis_calls":13,"redis_duration_s":0.004257,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001387,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00287,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022574,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034075,"completed_at":"2026-09-18T22:17:35.175Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2492gitlab # [ 462.311062] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:35.178Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fdf60a6275bbb9cf083e7913","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fdf60a6275bbb9cf083e7913: start","job_status":"start","queue_duration_s":2.461603,"scheduling_latency_s":2.461641}2493gitlab # [ 462.325137] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:35.209Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fdf60a6275bbb9cf083e7913","created_at":"2026-09-18T22:17:32.587Z","trace_propagation_headers":{"sentry-trace":"86905526f25f45e18f27feb62dc5a0ea-af5057dafa954ace","baggage":"sentry-trace_id=86905526f25f45e18f27feb62dc5a0ea,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7347fcffbdc52545dfc0f38a8a6e3e18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T22:17:32.716Z","job_size_bytes":2,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fdf60a6275bbb9cf083e7913: done: 0.031394 sec","job_status":"done","queue_duration_s":2.461603,"scheduling_latency_s":2.461641,"redis_calls":13,"redis_duration_s":0.004501,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001642,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002859,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020059,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031394,"completed_at":"2026-09-18T22:17:35.209Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2494gitlab # [ 462.364706] gitaly[920]: time="2026-09-18T22:17:36.977Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9HDTS6SNZG33ZPM3FFJ28 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T22:18:06.175" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:36.975" grpc.time_ms=1.288 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2495gitlab # [ 462.409578] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:37 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1912496gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses, in 0.29 seconds)2497gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses2498gitlab # [ 463.606214] gitaly[920]: time="2026-09-18T22:17:38.245Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9HF2D46HKZF1BT379ZN4T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T22:18:08.242" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:38.243" grpc.time_ms=1.513 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2499gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses, in 0.24 seconds)2500gitlab # [ 463.662954] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:38 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1762501gitlab # [ 464.457416] nix-daemon[3814]: accepted connection from pid 4910, user nixbot2502gitlab # [ 464.628590] gitaly[920]: time="2026-09-18T22:17:39.267Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9HG2HNKJ5DC35WVP59PZ7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T22:18:09.265" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:39.266" grpc.time_ms=1.307 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2503gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses2504gitlab # [ 464.770489] gitaly[920]: time="2026-09-18T22:17:39.410Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M2V9HG2HNKJ5DC35WVP59PZ7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T22:17:49.202" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:39.392" grpc.time_ms=17.527 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2505gitlab # [ 464.820681] gitaly[920]: time="2026-09-18T22:17:39.461Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9HG8Z4XZHCFS7W0Z687VY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T22:18:09.458" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:39.459" grpc.time_ms=1.137 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2506gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses, in 0.22 seconds)2507gitlab # [ 464.859855] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:39.498Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"3a4aaccd906072b7467411c5","created_at":"2026-09-18T22:17:39.486Z","trace_propagation_headers":{"sentry-trace":"eafc4840f3b7441e9ef5817ef9911c9a-9c9d5c9c97b94c95","baggage":"sentry-trace_id=eafc4840f3b7441e9ef5817ef9911c9a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9HG2HNKJ5DC35WVP59PZ7","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:39.495Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3a4aaccd906072b7467411c5: start","job_status":"start","queue_duration_s":0.003228,"scheduling_latency_s":0.003288}2508gitlab # [ 464.893121] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:39 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses HTTP/1.1" 200 678 "" "curl/8.21.0" 1582509gitlab # [ 464.897920] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:39 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a4bc83de92473a228fc3f855cea6097a4c6042c9 HTTP/1.1" 201 676 "" "python-httpx/0.28.1" 3762510gitlab # [ 464.903040] nixbot[3643]: {"ts": "2026-09-18T22:17:39.529Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a4bc83de92473a228fc3f855cea6097a4c6042c9 \"HTTP/1.1 201 Created\""}2511gitlab # [ 464.979026] gitaly[920]: time="2026-09-18T22:17:39.619Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9HGEGGS58PN5MXRY96Q0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T22:18:09.317" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:39.618" grpc.time_ms=0.822 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2512gitlab # [ 465.038765] gitaly[920]: time="2026-09-18T22:17:39.678Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M2V9HGEGGS58PN5MXRY96Q0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T22:17:49.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:39.665" grpc.time_ms=13.046 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2513gitlab # [ 465.084696] gitaly[920]: time="2026-09-18T22:17:39.724Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V9HG2HNKJ5DC35WVP59PZ7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T22:17:39.722" grpc.time_ms=1.634 pid=920 span.kind=server system=grpc2514gitlab # [ 465.112378] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:39 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a4bc83de92473a228fc3f855cea6097a4c6042c9 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2152515gitlab # [ 465.117280] nixbot[3643]: {"ts": "2026-09-18T22:17:39.754Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a4bc83de92473a228fc3f855cea6097a4c6042c9 \"HTTP/1.1 201 Created\""}2516gitlab # [ 465.129440] gitaly[920]: time="2026-09-18T22:17:39.770Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V9HG2HNKJ5DC35WVP59PZ7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T22:17:39.768" grpc.time_ms=1.172 pid=920 span.kind=server system=grpc2517gitlab # [ 465.177372] gitaly[920]: time="2026-09-18T22:17:39.817Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V9HG2HNKJ5DC35WVP59PZ7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T22:17:39.817" grpc.time_ms=0.735 pid=920 span.kind=server system=grpc2518gitlab # [ 465.199046] gitaly[920]: time="2026-09-18T22:17:39.829Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9HG2HNKJ5DC35WVP59PZ7 forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-18T22:18:09.765" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:39.665" operations="[repack_refs]" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2519gitlab # [ 465.218758] gitaly[920]: time="2026-09-18T22:17:39.832Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9HGNM0H130PWSF7MA93NH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T22:18:09.530" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:39.831" grpc.time_ms=0.734 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2520gitlab # [ 465.239568] gitaly[920]: time="2026-09-18T22:17:39.833Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9HG2HNKJ5DC35WVP59PZ7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-18T22:18:09.765" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:39.665" pid=920 remote_ip="2001:db8:1::1" repository_info="{false {6 704 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-09-18 22:15:36.852539 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2521gitlab # [ 465.257376] gitaly[920]: time="2026-09-18T22:17:39.838Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9HG2HNKJ5DC35WVP59PZ7 diskcache=e03b348f-a731-4d09-ba1b-3e8e3204d698 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-18T22:18:09.765" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:39.665" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2522gitlab # [ 465.270862] gitaly[920]: time="2026-09-18T22:17:39.840Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=163 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7392 command.oublock=0 command.real_time_ms=160 command.spawn_token_fork_ms=2 command.system_time_ms=92 command.user_time_ms=71 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9HG2HNKJ5DC35WVP59PZ7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-18T22:18:09.765" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:39.665" grpc.time_ms=172.552 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2523gitlab # [ 465.286479] gitaly[920]: time="2026-09-18T22:17:39.869Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9HG2HNKJ5DC35WVP59PZ7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-18T22:18:09.765" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:39.665" pid=920 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2524gitlab # [ 465.301466] gitaly[920]: time="2026-09-18T22:17:39.870Z" level=info msg="optimized repository" clean_stale_data_time=35.45492ms clean_work_trees_time="119.68µs" commit_graph_time=720ns correlation_id=01M2V9HG2HNKJ5DC35WVP59PZ7 gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="1.4µs" pid=920 prune_time=160ns relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="1.54µs" storage_name=default system=housekeeping total_time=35.6074ms2525gitlab # [ 465.308146] gitaly[920]: time="2026-09-18T22:17:39.870Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9HG2HNKJ5DC35WVP59PZ7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-18T22:18:09.765" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:39.665" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2526gitlab # [ 465.318422] gitaly[920]: time="2026-09-18T22:17:39.898Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M2V9HGNM0H130PWSF7MA93NH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T22:17:49.228" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T22:17:39.889" grpc.time_ms=9.285 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2527gitlab # [ 465.332793] gitaly[920]: time="2026-09-18T22:17:39.933Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9HG2HNKJ5DC35WVP59PZ7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-18T22:18:09.031" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:39.932" grpc.time_ms=1.293 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2528gitlab # [ 465.345498] gitaly[920]: time="2026-09-18T22:17:39.973Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9HG2HNKJ5DC35WVP59PZ7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T22:18:09.071" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T22:17:39.972" grpc.time_ms=0.924 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2529gitlab # [ 465.357933] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:39 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a4bc83de92473a228fc3f855cea6097a4c6042c9 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2202530gitlab # [ 465.360500] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:39.987Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"2172e80f3b28febfc76599f5","created_at":"2026-09-18T22:17:39.985Z","trace_propagation_headers":{"sentry-trace":"eafc4840f3b7441e9ef5817ef9911c9a-6985e77a62fa4b25","baggage":"sentry-trace_id=eafc4840f3b7441e9ef5817ef9911c9a,sentry-release=Unknown"},"correlation_id":"01M2V9HG2HNKJ5DC35WVP59PZ7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"3a4aaccd906072b7467411c5","job_size_bytes":3,"pid":3513,"job_status":"deduplicated","message":"PipelineProcessWorker JID-2172e80f3b28febfc76599f5: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2531gitlab # [ 465.376168] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:39.990Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"3a4aaccd906072b7467411c5","created_at":"2026-09-18T22:17:39.486Z","trace_propagation_headers":{"sentry-trace":"eafc4840f3b7441e9ef5817ef9911c9a-9c9d5c9c97b94c95","baggage":"sentry-trace_id=eafc4840f3b7441e9ef5817ef9911c9a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9HG2HNKJ5DC35WVP59PZ7","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:39.495Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3513,"job_status":"rescheduled","message":"PipelineProcessWorker JID-3a4aaccd906072b7467411c5: rescheduled"}2532gitlab # [ 465.392282] nixbot[3643]: {"ts": "2026-09-18T22:17:39.986Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a4bc83de92473a228fc3f855cea6097a4c6042c9 \"HTTP/1.1 201 Created\""}2533gitlab # [ 465.395007] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:40.000Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"3a4aaccd906072b7467411c5","created_at":"2026-09-18T22:17:39.486Z","trace_propagation_headers":{"sentry-trace":"eafc4840f3b7441e9ef5817ef9911c9a-9c9d5c9c97b94c95","baggage":"sentry-trace_id=eafc4840f3b7441e9ef5817ef9911c9a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V9HG2HNKJ5DC35WVP59PZ7","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:39.495Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3a4aaccd906072b7467411c5: done: 0.501878 sec","job_status":"done","queue_duration_s":0.003228,"scheduling_latency_s":0.003288,"gitaly_calls":3,"gitaly_duration_s":0.1879,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.019731000000000002,"redis_read_bytes":239,"redis_write_bytes":21784,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001836,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.003746,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14469,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.005884,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000648,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000483,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.003134,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.056,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.014,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.017,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.028,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.235428,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.4216252,"duration_s":0.501878,"completed_at":"2026-09-18T22:17:40.000Z","load_balancing_strategy":"primary","db_duration_s":0.06043,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2534gitlab # [ 465.446331] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:40.002Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"ba59b6df079cb28d053a9a8d","created_at":"2026-09-18T22:17:39.647Z","trace_propagation_headers":{"sentry-trace":"eafc4840f3b7441e9ef5817ef9911c9a-6985e77a62fa4b25","baggage":"sentry-trace_id=eafc4840f3b7441e9ef5817ef9911c9a,sentry-release=Unknown"},"correlation_id":"01M2V9HG2HNKJ5DC35WVP59PZ7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:39.652Z","job_size_bytes":23,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-ba59b6df079cb28d053a9a8d: start","job_status":"start","queue_duration_s":0.350331,"scheduling_latency_s":0.350369}2535gitlab # [ 465.462633] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:40.079Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"ba59b6df079cb28d053a9a8d","created_at":"2026-09-18T22:17:39.647Z","trace_propagation_headers":{"sentry-trace":"eafc4840f3b7441e9ef5817ef9911c9a-6985e77a62fa4b25","baggage":"sentry-trace_id=eafc4840f3b7441e9ef5817ef9911c9a,sentry-release=Unknown"},"correlation_id":"01M2V9HG2HNKJ5DC35WVP59PZ7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:39.652Z","job_size_bytes":23,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-ba59b6df079cb28d053a9a8d: done: 0.076348 sec","job_status":"done","queue_duration_s":0.350331,"scheduling_latency_s":0.350369,"redis_calls":7,"redis_duration_s":0.0022040000000000002,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001748,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000456,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054725,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.076348,"completed_at":"2026-09-18T22:17:40.079Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016917,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2536gitlab # [ 465.504862] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:40.081Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"d101716e1367eaf7cf75bc57","created_at":"2026-09-18T22:17:39.850Z","trace_propagation_headers":{"sentry-trace":"eafc4840f3b7441e9ef5817ef9911c9a-6985e77a62fa4b25","baggage":"sentry-trace_id=eafc4840f3b7441e9ef5817ef9911c9a,sentry-release=Unknown"},"correlation_id":"01M2V9HG2HNKJ5DC35WVP59PZ7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:39.853Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-d101716e1367eaf7cf75bc57: start","job_status":"start","queue_duration_s":0.227545,"scheduling_latency_s":0.22758}2537gitlab # [ 465.521189] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:40.131Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"d101716e1367eaf7cf75bc57","created_at":"2026-09-18T22:17:39.850Z","trace_propagation_headers":{"sentry-trace":"eafc4840f3b7441e9ef5817ef9911c9a-6985e77a62fa4b25","baggage":"sentry-trace_id=eafc4840f3b7441e9ef5817ef9911c9a,sentry-release=Unknown"},"correlation_id":"01M2V9HG2HNKJ5DC35WVP59PZ7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:39.853Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-d101716e1367eaf7cf75bc57: done: 0.050595 sec","job_status":"done","queue_duration_s":0.227545,"scheduling_latency_s":0.22758,"redis_calls":7,"redis_duration_s":0.002248,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00162,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000628,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.050595,"completed_at":"2026-09-18T22:17:40.131Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010689,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2538gitlab # [ 465.562972] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:40.133Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"d5bd3a38b1fccba293e9d6db","created_at":"2026-09-18T22:17:39.872Z","trace_propagation_headers":{"sentry-trace":"eafc4840f3b7441e9ef5817ef9911c9a-6985e77a62fa4b25","baggage":"sentry-trace_id=eafc4840f3b7441e9ef5817ef9911c9a,sentry-release=Unknown"},"correlation_id":"01M2V9HG2HNKJ5DC35WVP59PZ7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:39.875Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-d5bd3a38b1fccba293e9d6db: start","job_status":"start","queue_duration_s":0.258546,"scheduling_latency_s":0.258574}2539gitlab # [ 465.709843] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:40.349Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"d5bd3a38b1fccba293e9d6db","created_at":"2026-09-18T22:17:39.872Z","trace_propagation_headers":{"sentry-trace":"eafc4840f3b7441e9ef5817ef9911c9a-6985e77a62fa4b25","baggage":"sentry-trace_id=eafc4840f3b7441e9ef5817ef9911c9a,sentry-release=Unknown"},"correlation_id":"01M2V9HG2HNKJ5DC35WVP59PZ7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:39.875Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-d5bd3a38b1fccba293e9d6db: done: 0.216044 sec","job_status":"done","queue_duration_s":0.258546,"scheduling_latency_s":0.258574,"redis_calls":7,"redis_duration_s":0.002487,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001688,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000799,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.200859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.216044,"completed_at":"2026-09-18T22:17:40.349Z","load_balancing_strategy":"primary","db_duration_s":0.008238,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2540gitlab # [ 465.784285] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:40.351Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"835e33bede1b5965d1f25158","created_at":"2026-09-18T22:17:39.885Z","trace_propagation_headers":{"sentry-trace":"eafc4840f3b7441e9ef5817ef9911c9a-6985e77a62fa4b25","baggage":"sentry-trace_id=eafc4840f3b7441e9ef5817ef9911c9a,sentry-release=Unknown"},"correlation_id":"01M2V9HG2HNKJ5DC35WVP59PZ7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:39.887Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-835e33bede1b5965d1f25158: start","job_status":"start","queue_duration_s":0.463871,"scheduling_latency_s":0.463896}2541gitlab # [ 465.803301] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:40.402Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"835e33bede1b5965d1f25158","created_at":"2026-09-18T22:17:39.885Z","trace_propagation_headers":{"sentry-trace":"eafc4840f3b7441e9ef5817ef9911c9a-6985e77a62fa4b25","baggage":"sentry-trace_id=eafc4840f3b7441e9ef5817ef9911c9a,sentry-release=Unknown"},"correlation_id":"01M2V9HG2HNKJ5DC35WVP59PZ7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:39.887Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-835e33bede1b5965d1f25158: done: 0.051157 sec","job_status":"done","queue_duration_s":0.463871,"scheduling_latency_s":0.463896,"redis_calls":10,"redis_duration_s":0.003376,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001346,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001446,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000584,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037621,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.051157,"completed_at":"2026-09-18T22:17:40.402Z","load_balancing_strategy":"primary","db_duration_s":0.006806,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2542gitlab # [ 465.851545] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:40.406Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"16aa6d1a9933a1073c00592e","created_at":"2026-09-18T22:17:39.888Z","trace_propagation_headers":{"sentry-trace":"eafc4840f3b7441e9ef5817ef9911c9a-6985e77a62fa4b25","baggage":"sentry-trace_id=eafc4840f3b7441e9ef5817ef9911c9a,sentry-release=Unknown"},"correlation_id":"01M2V9HG2HNKJ5DC35WVP59PZ7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:39.890Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-16aa6d1a9933a1073c00592e: start","job_status":"start","queue_duration_s":0.516088,"scheduling_latency_s":0.516138}2543gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses2544gitlab # [ 465.868878] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:40.466Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"16aa6d1a9933a1073c00592e","created_at":"2026-09-18T22:17:39.888Z","trace_propagation_headers":{"sentry-trace":"eafc4840f3b7441e9ef5817ef9911c9a-6985e77a62fa4b25","baggage":"sentry-trace_id=eafc4840f3b7441e9ef5817ef9911c9a,sentry-release=Unknown"},"correlation_id":"01M2V9HG2HNKJ5DC35WVP59PZ7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:39.890Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-16aa6d1a9933a1073c00592e: done: 0.060305 sec","job_status":"done","queue_duration_s":0.516088,"scheduling_latency_s":0.516138,"redis_calls":7,"redis_duration_s":0.002758,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002028,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00073,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039906,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.060305,"completed_at":"2026-09-18T22:17:40.466Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010101,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2545gitlab # [ 465.909493] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:40 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1002546gitlab # [ 465.911774] gitaly[920]: time="2026-09-18T22:17:40.472Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=3 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V9HH8MY5WT1HQA3W7JGVH9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:17:40.457" grpc.time_ms=14.947 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2547gitlab # [ 465.924846] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:40.470Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"b8e28c135849eea7dea7f5b2","created_at":"2026-09-18T22:17:39.890Z","trace_propagation_headers":{"sentry-trace":"eafc4840f3b7441e9ef5817ef9911c9a-6985e77a62fa4b25","baggage":"sentry-trace_id=eafc4840f3b7441e9ef5817ef9911c9a,sentry-release=Unknown"},"correlation_id":"01M2V9HG2HNKJ5DC35WVP59PZ7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:39.893Z","job_size_bytes":19,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-b8e28c135849eea7dea7f5b2: start","job_status":"start","queue_duration_s":0.576734,"scheduling_latency_s":0.576773}2548gitlab # [ 465.940692] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:40.518Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"b8e28c135849eea7dea7f5b2","created_at":"2026-09-18T22:17:39.890Z","trace_propagation_headers":{"sentry-trace":"eafc4840f3b7441e9ef5817ef9911c9a-6985e77a62fa4b25","baggage":"sentry-trace_id=eafc4840f3b7441e9ef5817ef9911c9a,sentry-release=Unknown"},"correlation_id":"01M2V9HG2HNKJ5DC35WVP59PZ7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:39.893Z","job_size_bytes":19,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-b8e28c135849eea7dea7f5b2: done: 0.048478 sec","job_status":"done","queue_duration_s":0.576734,"scheduling_latency_s":0.576773,"redis_calls":8,"redis_duration_s":0.0027089999999999996,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002113,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000596,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048478,"completed_at":"2026-09-18T22:17:40.518Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009463,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2549gitlab # [ 465.985428] gitaly[920]: time="2026-09-18T22:17:40.587Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2V9HHBVCE2RHCCFGG6W30Y8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:17:40.566" pid=920 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2550gitlab # [ 465.995934] gitlab-workhorse[822]: time="2026-09-18T22:17:40Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672551gitlab # [ 465.997909] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:40 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1122552gitlab # [ 465.999751] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:40.521Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"1e0a04658100b018cc2c0aff","created_at":"2026-09-18T22:17:39.894Z","trace_propagation_headers":{"sentry-trace":"eafc4840f3b7441e9ef5817ef9911c9a-6985e77a62fa4b25","baggage":"sentry-trace_id=eafc4840f3b7441e9ef5817ef9911c9a,sentry-release=Unknown"},"correlation_id":"01M2V9HG2HNKJ5DC35WVP59PZ7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:39.897Z","job_size_bytes":66,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-1e0a04658100b018cc2c0aff: start","job_status":"start","queue_duration_s":0.623931,"scheduling_latency_s":0.623966}2553gitlab # [ 466.018296] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:40.566Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"1e0a04658100b018cc2c0aff","created_at":"2026-09-18T22:17:39.894Z","trace_propagation_headers":{"sentry-trace":"eafc4840f3b7441e9ef5817ef9911c9a-6985e77a62fa4b25","baggage":"sentry-trace_id=eafc4840f3b7441e9ef5817ef9911c9a,sentry-release=Unknown"},"correlation_id":"01M2V9HG2HNKJ5DC35WVP59PZ7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:39.897Z","job_size_bytes":66,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-1e0a04658100b018cc2c0aff: done: 0.045183 sec","job_status":"done","queue_duration_s":0.623931,"scheduling_latency_s":0.623966,"redis_calls":7,"redis_duration_s":0.007632000000000001,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006917,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000715,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026639,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.045183,"completed_at":"2026-09-18T22:17:40.566Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006355,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2554gitlab # [ 466.061656] gitaly[920]: time="2026-09-18T22:17:40.587Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=4 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9HHBVCE2RHCCFGG6W30Y8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:17:40.566" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2555gitlab # [ 466.075011] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:40.568Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"dd2141343a1f8c1b9c8404c8","created_at":"2026-09-18T22:17:39.898Z","trace_propagation_headers":{"sentry-trace":"eafc4840f3b7441e9ef5817ef9911c9a-6985e77a62fa4b25","baggage":"sentry-trace_id=eafc4840f3b7441e9ef5817ef9911c9a,sentry-release=Unknown"},"correlation_id":"01M2V9HG2HNKJ5DC35WVP59PZ7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:39.900Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-dd2141343a1f8c1b9c8404c8: start","job_status":"start","queue_duration_s":0.667898,"scheduling_latency_s":0.66793}2556gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses, in 0.24 seconds)2557(finished: subtest: eval and build post commit statuses, in 11.40 seconds)2558(finished: run the VM test script, in 540.89 seconds)2559gitlab # [ 466.091078] sidekiq-cluster[3513]: {"severity":"INFO","time":"2026-09-18T22:17:40.622Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"dd2141343a1f8c1b9c8404c8","created_at":"2026-09-18T22:17:39.898Z","trace_propagation_headers":{"sentry-trace":"eafc4840f3b7441e9ef5817ef9911c9a-6985e77a62fa4b25","baggage":"sentry-trace_id=eafc4840f3b7441e9ef5817ef9911c9a,sentry-release=Unknown"},"correlation_id":"01M2V9HG2HNKJ5DC35WVP59PZ7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-18T22:17:39.900Z","job_size_bytes":3,"pid":3513,"sidekiq_tid":"m8r5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-dd2141343a1f8c1b9c8404c8: done: 0.054446 sec","job_status":"done","queue_duration_s":0.667898,"scheduling_latency_s":0.66793,"redis_calls":7,"redis_duration_s":0.001508,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001085,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000423,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03892,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.054446,"completed_at":"2026-09-18T22:17:40.622Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009669,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2560gitlab # [ 466.133768] gitaly[920]: time="2026-09-18T22:17:40.587Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=4 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M2V9HHBVCE2RHCCFGG6W30Y8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T22:17:40.566" grpc.time_ms=20.977 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2561gitlab # [ 466.157756] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:40 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a4bc83de92473a228fc3f855cea6097a4c6042c9/statuses HTTP/1.1" 200 1335 "" "curl/8.21.0" 1582562test script finished in 540.93s2563cleanup2564gitlab # [ 466.161274] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/09/18:22:17:40 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1172565kill QemuMachine (pid 46)2566gitlab # [ 466.163810] sidekiq-cluster[3513]: {"severitqemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)2567gitlab # y2568(finished: cleanup, in 1.92 seconds)2569additionally exposed symbols:2570 gitlab,2571 vlan1,2572 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2573[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-18T22:15:50.162Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2574[]2575[]2576[]2577[]2578[]2579[]2580[]2581[]2582[]2583[]2584[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'a4bc83de92473a228fc3f855cea6097a4c6042c9', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-09-18T22:17:28.367487Z', 'started_at': '2026-09-18T22:17:28.933714Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}]2585[{'id': 5, 'sha': 'a4bc83de92473a228fc3f855cea6097a4c6042c9', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-18T22:17:28.877Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2586[{'id': 5, 'sha': 'a4bc83de92473a228fc3f855cea6097a4c6042c9', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-18T22:17:28.877Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2587[{'id': 5, 'sha': 'a4bc83de92473a228fc3f855cea6097a4c6042c9', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-18T22:17:28.877Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2588[{'id': 5, 'sha': 'a4bc83de92473a228fc3f855cea6097a4c6042c9', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-18T22:17:28.877Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2589[{'id': 5, 'sha': 'a4bc83de92473a228fc3f855cea6097a4c6042c9', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-18T22:17:28.877Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2590[{'id': 5, 'sha': 'a4bc83de92473a228fc3f855cea6097a4c6042c9', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-18T22:17:28.877Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2591[{'id': 5, 'sha': 'a4bc83de92473a228fc3f855cea6097a4c6042c9', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-18T22:17:28.877Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2592[{'id': 5, 'sha': 'a4bc83de92473a228fc3f855cea6097a4c6042c9', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-18T22:17:28.877Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2593[{'id': 5, 'sha': 'a4bc83de92473a228fc3f855cea6097a4c6042c9', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 10s (1 warning)', 'created_at': '2026-09-18T22:17:28.877Z', 'started_at': None, 'finished_at': '2026-09-18T22:17:39.466Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2594[{'id': 5, 'sha': 'a4bc83de92473a228fc3f855cea6097a4c6042c9', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 10s (1 warning)', 'created_at': '2026-09-18T22:17:28.877Z', 'started_at': None, 'finished_at': '2026-09-18T22:17:39.466Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'a4bc83de92473a228fc3f855cea6097a4c6042c9', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-09-18T22:17:39.715Z', 'started_at': None, 'finished_at': '2026-09-18T22:17:39.935Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]