nixbot

builds

succeeded vm-test-run-nixbot-gitlab checks.aarch64-linux.nixbot-gitlab · build #343 · raw

1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.sZrPC602nX', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13(finished: start all VMs, in 70.61 seconds)14gitlab # Discarding device blocks: 0/262144 done15gitlab: waiting for unit setup-gitlab.service16gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes17gitlab: waiting for the VM to finish booting18gitlab # Filesystem UUID: 379cd3c5-ff5b-42c1-bc0b-65f67746c79919gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/nkba7da9br4q97qjx52b46jx0nqfjr52-nixos-system-gitlab-test/init regInfo=/nix/store/f9lv17sr6apmzid3af6imq792bvl596a-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/f9lv17sr6apmzid3af6imq792bvl596a-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000029] arm-pv: using stolen time PV108gitlab # [ 0.000387] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000572] Console: colour dummy device 80x25110gitlab # [ 0.000580] printk: legacy console [tty0] enabled111gitlab # [ 0.000769] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000776] pid_max: default: 32768 minimum: 301113gitlab # [ 0.000844] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.001018] landlock: Up and running.115gitlab # [ 0.001020] Yama: becoming mindful.116gitlab # [ 0.001435] LSM support for eBPF active117gitlab # [ 0.001633] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.001741] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.002872] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.003550] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.003554] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.003702] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.004747] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.004839] EFI services will not be available.125gitlab # [ 0.005015] smp: Bringing up secondary CPUs ...126gitlab # [ 0.005674] Detected PIPT I-cache on CPU1127gitlab # [ 0.005773] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.005919] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000129gitlab # [ 0.006046] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.007203] Detected PIPT I-cache on CPU2131gitlab # [ 0.007308] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.007439] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000133gitlab # [ 0.007568] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.008644] Detected PIPT I-cache on CPU3135gitlab # [ 0.008761] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.008893] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000137gitlab # [ 0.009025] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.009558] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.009586] SMP: Total of 4 processors activated.140gitlab # [ 0.009589] CPU: All CPU(s) started at EL1141gitlab # [ 0.009599] CPU features: detected: Branch Target Identification142gitlab # [ 0.009603] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.009605] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.009609] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.009612] CPU features: detected: Common not Private translations146gitlab # [ 0.009615] CPU features: detected: CRC32 instructions147gitlab # [ 0.009617] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.009621] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.009623] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.009626] CPU features: detected: E0PD151gitlab # [ 0.009628] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.009631] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.009634] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.009636] CPU features: detected: Fine Grained Traps155gitlab # [ 0.009639] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.009643] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.009646] CPU features: detected: LSE atomic instructions158gitlab # [ 0.009648] CPU features: detected: Privileged Access Never159gitlab # [ 0.009650] CPU features: detected: PMUv3160gitlab # [ 0.009653] CPU features: detected: RAS Extension Support161gitlab # [ 0.009655] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.009658] CPU features: detected: Random Number Generator163gitlab # [ 0.009660] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.009663] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.009665] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.009669] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.009804] alternatives: applying system-wide alternatives168gitlab # [ 0.012712] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.012924] Memory: 5963772K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.014317] devtmpfs: initialized171gitlab # [ 0.018586] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.018657] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.018842] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.018847] 0 pages in range for non-PLT usage175gitlab # [ 0.018848] 508288 pages in range for PLT usage176gitlab # [ 0.018971] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.019816] DMI not present or invalid.178gitlab # [ 0.023045] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.025635] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.025932] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.027784] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.027804] audit: initializing netlink subsys (disabled)183gitlab # [ 0.028093] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.028563] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.028566] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.028570] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.028573] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.028575] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.028655] cpuidle: using governor ladder190gitlab # [ 0.028720] cpuidle: using governor menu191gitlab # [ 0.028917] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.029121] ASID allocator initialised with 65536 entries193gitlab # [ 0.030223] Serial: AMBA PL011 UART driver194gitlab # [ 0.035237] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.035584] printk: console [ttyAMA0] enabled196gitlab # [ 0.047340] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.047361] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.047371] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.047379] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.047388] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.047396] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.047404] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.047412] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.059094] fbcon: Taking over console205gitlab # [ 0.059105] ACPI: Interpreter disabled.206gitlab # [ 0.060150] iommu: Default domain type: Translated207gitlab # [ 0.060167] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.069792] SCSI subsystem initialized209gitlab # [ 0.070270] usbcore: registered new interface driver usbfs210gitlab # [ 0.070300] usbcore: registered new interface driver hub211gitlab # [ 0.070319] usbcore: registered new device driver usb212gitlab # [ 0.070664] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.070668] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.070687] PTP clock support registered215gitlab # [ 0.070733] EDAC MC: Ver: 3.0.0216gitlab # [ 0.071275] scmi_core: SCMI protocol bus registered217gitlab # [ 0.072298] FPGA manager framework218gitlab # [ 0.073055] vgaarb: loaded219gitlab # [ 0.074883] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.094373] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.094445] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.095331] netfs: FS-Cache loaded223gitlab # [ 0.095629] pnp: PnP ACPI: disabled224gitlab # [ 0.107269] NET: Registered PF_INET protocol family225gitlab # [ 0.109917] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.170740] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.170806] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.170866] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.171313] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.172185] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.172366] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.172440] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.172612] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.172897] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.172919] NET: Registered PF_XDP protocol family236gitlab # [ 0.172939] PCI: CLS 0 bytes, default 64237gitlab # [ 0.173300] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.187574] kvm [1]: HYP mode not available239gitlab # [ 0.260795] Initialise system trusted keyrings240gitlab # [ 0.261079] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.261777] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.261957] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.277205] Key type asymmetric registered244gitlab # [ 0.277217] Asymmetric key parser 'x509' registered245gitlab # [ 0.277278] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.277480] io scheduler mq-deadline registered247gitlab # [ 0.277485] io scheduler kyber registered248gitlab # [ 0.288629] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.291047] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.291617] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.291637] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.291650] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.291658] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.291686] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.291714] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.291811] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.291823] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.291829] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.291833] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.291838] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.291974] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.292781] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.293106] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.293126] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.293178] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.293197] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.294066] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.294407] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.294434] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.294485] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.295358] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.295699] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.295726] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.295777] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.296620] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.296960] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.296978] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.297028] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.297851] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.298190] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.298209] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.298258] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.299109] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.299448] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.299475] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.299527] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.300382] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.300707] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.300726] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.300776] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.300795] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.301637] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.301980] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.302022] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.302837] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.303178] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.303230] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.303952] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.304292] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.304713] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.305109] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.305129] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.305176] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.306023] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.306350] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.306369] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.306418] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.307441] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.307452] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.307457] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.307534] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.307611] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.307681] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.307760] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.307843] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.307917] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.307997] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.308075] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.308155] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.308253] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.308323] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.308352] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.308380] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.308408] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.308436] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.308465] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.308499] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.308534] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.308564] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.308601] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.308632] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.308661] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.308690] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.308717] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.308746] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.308774] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.308803] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.308831] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.308859] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.308888] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.308924] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.308966] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.308974] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.308979] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.311176] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.328968] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.331879] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.334777] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.337812] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.343956] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.346748] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.349575] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.352461] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.358820] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.361501] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.364397] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.372307] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.374830] msm_serial: driver initialized359gitlab # [ 0.375054] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.375131] STM32 USART driver initialized361gitlab # [ 0.409523] loop: module loaded362gitlab # [ 0.409842] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.412599] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.415217] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.417795] virtio_blk virtio5: [vdb] 12284888 512-byte logical blocks (6.29 GB/5.86 GiB)366gitlab # [ 0.420540] megasas: 07.734.00.00-rc1367gitlab # [ 0.421492] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.424164] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.424247] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.426590] Using buffer write method371gitlab # [ 0.426626] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.429196] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.429215] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.431753] Using buffer write method375gitlab # [ 0.431771] Concatenating MTD devices:376gitlab # [ 0.431774] (0): "0.flash"377gitlab # [ 0.431777] (1): "0.flash"378gitlab # [ 0.431780] into device "0.flash"379gitlab # [ 0.610720] Freeing initrd memory: 27184K380gitlab # [ 0.628218] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.636923] thunder_xcv, ver 1.0382gitlab # [ 0.637034] thunder_bgx, ver 1.0383gitlab # [ 0.637096] nicpf, ver 1.0384gitlab # [ 0.639173] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.639196] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.639262] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.639279] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.639373] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.639382] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.639468] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.639479] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.639910] sky2: driver version 1.30393gitlab # [ 0.644940] usbcore: registered new interface driver usb-storage394gitlab # [ 0.645307] usbcore: registered new interface driver usbserial_generic395gitlab # [ 0.645356] usbserial: USB Serial support registered for generic396gitlab # [ 0.645551] ehci-pci 0000:00:0a.0: EHCI Host Controller397gitlab # [ 0.645626] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1398gitlab # [ 0.646374] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000399gitlab # [ 0.647158] hv_vmbus: registering driver hyperv_keyboard400gitlab # [ 0.649592] rtc-pl031 9010000.pl031: registered as rtc0401gitlab # [ 0.649671] rtc-pl031 9010000.pl031: setting system clock to 2026-09-06T15:20:16 UTC (1788708016)402gitlab # [ 0.650574] i2c_dev: i2c /dev entries driver403gitlab # [ 0.658908] sdhci: Secure Digital Host Controller Interface driver404gitlab # [ 0.658920] sdhci: Copyright(c) Pierre Ossman405gitlab # [ 0.658976] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00406gitlab # [ 0.659705] Synopsys Designware Multimedia Card Interface Driver407gitlab # [ 0.660395] hub 1-0:1.0: USB hub found408gitlab # [ 0.660508] hub 1-0:1.0: 6 ports detected409gitlab # [ 0.660849] sdhci-pltfm: SDHCI platform and OF driver helper410gitlab # [ 0.665642] hid: raw HID events driver (C) Jiri Kosina411gitlab # [ 0.666527] usbcore: registered new interface driver usbhid412gitlab # [ 0.666537] usbhid: USB HID core driver413gitlab # [ 0.688312] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.692946] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.693338] NET: Registered PF_INET6 protocol family416gitlab # [ 0.695270] Segment Routing with IPv6417gitlab # [ 0.695305] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.695372] NET: Registered PF_PACKET protocol family419gitlab # [ 0.695618] 9pnet: Installing 9P2000 support420gitlab # [ 0.699954] Key type dns_resolver registered421gitlab # [ 0.717493] registered taskstats version 1422gitlab # [ 0.718008] Loading compiled-in X.509 certificates423gitlab # [ 0.737834] Demotion targets for Node 0: null424gitlab # [ 0.738075] Key type .fscrypt registered425gitlab # [ 0.738082] Key type fscrypt-provisioning registered426gitlab # [ 0.738245] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.738266] ima: Allocated hash algorithm: sha1428gitlab # [ 0.738291] ima: No architecture policies found429gitlab # [ 0.739420] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.764055] clk: Disabling unused clocks431gitlab # [ 0.764083] PM: genpd: Disabling unused power domains432gitlab # [ 0.769323] Freeing unused kernel memory: 4736K433gitlab # [ 0.769534] Run /init as init process434gitlab # [ 0.796938] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 0.906952] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.061990] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.131309] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)438gitlab # [ 1.131375] systemd[1]: Detected virtualization qemu.439gitlab # [ 1.131443] systemd[1]: Detected architecture arm64.440gitlab # [ 1.131459] systemd[1]: Running in initrd.441gitlab # [ 1.132295] systemd[1]: Initializing machine ID from random generator.442gitlab # [ 1.132538] systemd[1]: Hostname set to <gitlab>.443gitlab # [ 1.171629] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0444gitlab # [ 1.290994] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.423321] systemd[1]: bpf-restrict-fs: LSM BPF program attached446gitlab # [ 1.447697] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2447gitlab # [ 1.451334] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0448gitlab # [ 1.523703] systemd[1]: Queued start job for default target Initrd Default Target.449gitlab # [ 1.543004] systemd[1]: Created slice Slice /system/modprobe.450gitlab # [ 1.543345] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.451gitlab # [ 1.543394] systemd[1]: Expecting device /dev/disk/by-label/nix-store...452gitlab # [ 1.543414] systemd[1]: Expecting device /dev/disk/by-label/nixos...453gitlab # [ 1.543451] systemd[1]: Reached target Path Units.454gitlab # [ 1.543477] systemd[1]: Reached target Slice Units.455gitlab # [ 1.543506] systemd[1]: Reached target Swaps.456gitlab # [ 1.543531] systemd[1]: Reached target Timer Units.457gitlab # [ 1.543760] systemd[1]: Listening on D-Bus System Message Bus Socket.458gitlab # [ 1.543989] systemd[1]: Listening on Journal Socket (/dev/log).459gitlab # [ 1.544211] systemd[1]: Listening on Journal Sockets.460gitlab # [ 1.544436] systemd[1]: Listening on udev Control Socket.461gitlab # [ 1.544567] systemd[1]: Listening on udev Kernel Socket.462gitlab # [ 1.544596] systemd[1]: Reached target Socket Units.463gitlab # [ 1.547064] systemd[1]: Starting Create List of Static Device Nodes...464gitlab # [ 1.549412] systemd[1]: Starting Load Kernel Module 9pnet_virtio...465gitlab # [ 1.549504] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs466gitlab # [ 1.551991] systemd[1]: Mounting Kernel Configuration File System...467gitlab # [ 1.577393] systemd[1]: Starting Journal Service...468gitlab # [ 1.581556] systemd[1]: Starting Load Kernel Modules...469gitlab # [ 1.581772] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os470gitlab # [ 1.585095] systemd[1]: Starting Coldplug All udev Devices...471gitlab # [ 1.594028] systemd[1]: Finished Create List of Static Device Nodes.472gitlab # [ 1.597177] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.473gitlab # [ 1.598074] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 1.598790] systemd[1]: Mounted Kernel Configuration File System.475gitlab # [ 1.602606] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...476gitlab # [ 1.613607] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.477gitlab # [ 1.613920] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev478gitlab # [ 1.626245] systemd-journald[94]: Collecting audit messages is disabled.479gitlab # [ 1.626507] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0480gitlab # [ 1.626721] [drm] features: -virgl +edid -resource_blob -host_visible481gitlab # [ 1.626726] [drm] features: -context_init482gitlab # [ 1.628136] [drm] number of scanouts: 1483gitlab # [ 1.628155] [drm] number of cap sets: 0484gitlab # [ 1.630248] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic485gitlab # [ 1.630262] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0486gitlab # [ 1.639666] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.487gitlab # [ 1.641799] Console: switching to colour frame buffer device 160x50488gitlab # [ 1.647874] systemd[1]: Starting Create Static Device Nodes in /dev...489gitlab # [ 1.648922] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device490gitlab # [ 1.668391] systemd[1]: Finished Load Kernel Modules.491gitlab # [ 1.675013] systemd[1]: Starting Apply Kernel Variables...492gitlab # [ 1.679188] systemd[1]: Finished Create Static Device Nodes in /dev.493gitlab # [ 1.679545] systemd[1]: Reached target Preparation for Local File Systems.494gitlab # [ 1.683014] systemd[1]: Reached target Local File Systems.495gitlab # [ 1.699778] systemd-modules-load[95]: Using 4 probe threads496gitlab # [ 1.701136] systemd-modules-load[95]: Module 'virtio_balloon' is built in497gitlab # [ 1.702303] systemd-modules-load[95]: Module 'virtio_console' is built in498gitlab # [ 1.703473] systemd-modules-load[95]: Module 'virtio_rng' is built in[ 1.703964] systemd[1]: Starting Rule-based Manager for Device Events and Files...499gitlab # 500gitlab # [ 1.704414] systemd[1]: Started Journal Service.501gitlab # [ 1.709213] systemd-modules-load[95]: Inserted module 'dm_mod'502gitlab # [ 1.710837] systemd-modules-load[95]: Inserted module 'virtio_gpu'503gitlab # [ 1.719579] systemd[1]: Finished Apply Kernel Variables.504gitlab # [ 1.722373] systemd[1]: Starting Create System Files and Directories...505gitlab # [ 1.755432] systemd[1]: Finished Create System Files and Directories.506gitlab # [ 1.785812] systemd-udevd[107]: Using default interface naming scheme 'v261'.507gitlab # [ 1.808832] systemd[1]: Started Rule-based Manager for Device Events and Files.508gitlab # [ 1.837551] systemd[1]: Starting Virtual Console Setup...509gitlab # [ 1.900251] systemd-vconsole-setup[129]: Configuration of first virtual console was skipped, ignoring remaining ones.510gitlab # [ 1.906732] systemd[1]: Finished Virtual Console Setup.511gitlab # [ 2.230600] systemd[1]: Finished Coldplug All udev Devices.512gitlab # [ 2.233328] systemd[1]: Reached target System Initialization.513gitlab # [ 2.235806] systemd[1]: Reached target Basic System.514gitlab # [ 2.455509] (udev-worker)[123]: Network interface NamePolicy= disabled on kernel command line.515gitlab # [ 2.465173] (udev-worker)[118]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.516gitlab # [ 2.474275] (udev-worker)[118]: Network interface NamePolicy= disabled on kernel command line.517gitlab # [ 2.488404] systemd[1]: Found device /dev/disk/by-label/nixos.518gitlab # [ 2.490523] systemd[1]: Reached target Initrd Root Device.519gitlab # [ 2.493310] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...520gitlab # [ 2.504155] systemd[1]: Found device /dev/disk/by-label/nix-store.521gitlab # [ 2.560946] systemd-fsck[152]: nixos: clean, 12/65536 files, 13019/262144 blocks522gitlab # [ 2.566489] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.523gitlab # [ 2.585587] systemd[1]: Mounting /sysroot...524gitlab # [ 2.662751] EXT4-fs (vda): mounted filesystem 379cd3c5-ff5b-42c1-bc0b-65f67746c799 r/w with ordered data mode. Quota mode: none.525gitlab # [ 2.664988] systemd[1]: Mounted /sysroot.526gitlab # [ 2.666489] systemd[1]: Reached target Initrd Root File System.527gitlab # [ 2.670490] systemd[1]: Mounting /sysroot/nix/.ro-store...528gitlab # [ 2.672462] systemd[1]: Mounting /sysroot/nix/.rw-store...529gitlab # [ 2.679398] systemd[1]: Mounting /sysroot/run...530gitlab # [ 2.695301] systemd[1]: Mounting /sysroot/tmp/shared...531gitlab # [ 2.707103] systemd[1]: Mounting /sysroot/tmp/xchg...532gitlab # [ 2.716386] systemd[1]: Starting Mountpoints Configured in the Real Root...533gitlab # [ 2.731021] systemd-sysroot-fstab-check[166]: /sysroot should be mounted in the initrd, will request daemon-reload.534gitlab # [ 2.739900] systemd[1]: Mounted /sysroot/nix/.rw-store.535gitlab # [ 2.741946] systemd[1]: Mounted /sysroot/run.536gitlab # [ 2.758956] systemd[1]: Starting rw-sysroot-nix-store.service...537gitlab # [ 2.761162] systemd[1]: Reload requested from client PID 166 ('systemd-sysroot') (unit initrd-parse-etc.service)...538gitlab # [ 2.762911] systemd[1]: Reloading...539gitlab # [ 2.961954] erofs (device vdb): mounted with root inode @ nid 128.540gitlab # [ 3.018340] systemd[1]: Reloading finished in 256 ms.541gitlab # [ 3.072590] systemd-sysroot-fstab-check[166]: Requesting initrd-fs.target/start/replace...542gitlab # [ 3.075480] systemd[1]: Mounted /sysroot/nix/.ro-store.543gitlab # [ 3.080164] systemd[1]: Mounted /sysroot/tmp/shared.544gitlab # [ 3.081002] systemd[1]: Mounted /sysroot/tmp/xchg.545gitlab # [ 3.081950] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.546gitlab # [ 3.082991] systemd[1]: Finished rw-sysroot-nix-store.service.547gitlab # [ 3.084307] systemd-sysroot-fstab-check[166]: Requesting swap.target/start/replace...548gitlab # [ 3.085703] systemd[1]: Starting rw-sysroot-nix-store.service...549gitlab # [ 3.089437] systemd[1]: initrd-parse-etc.service: Deactivated successfully.550gitlab # [ 3.100651] systemd[1]: Finished Mountpoints Configured in the Real Root.551gitlab # [ 3.101859] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.552gitlab # [ 3.104804] (udev-worker)[140]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory553gitlab # [ 3.107747] (udev-worker)[140]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory554gitlab # [ 3.111569] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.555gitlab # [ 3.112671] systemd[1]: Finished rw-sysroot-nix-store.service.556gitlab # [ 3.118873] systemd[1]: Mounting /sysroot/nix/store...557gitlab # [ 3.119671] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.558gitlab # [ 3.120796] systemd[1]: Stopped Virtual Console Setup.559gitlab # [ 3.121537] systemd[1]: Stopping Virtual Console Setup...560gitlab # [ 3.122316] systemd[1]: Starting Virtual Console Setup...561gitlab # [ 3.156375] systemd-vconsole-setup[200]: Configuration of first virtual console was skipped, ignoring remaining ones.562gitlab # [ 3.158413] systemd[1]: Finished Virtual Console Setup.563gitlab # [ 3.160543] systemd[1]: Mounted /sysroot/nix/store.564gitlab # [ 3.162310] systemd[1]: Reached target Initrd File Systems.565gitlab # [ 3.164211] systemd[1]: Starting Find NixOS closure...566gitlab # [ 3.166296] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...567gitlab # [ 3.183392] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.568gitlab # [ 3.197620] systemd[1]: Finished Find NixOS closure.569gitlab # [ 3.198564] systemd[1]: Reached target Initrd Default Target.570gitlab # [ 3.200562] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...571gitlab # [ 3.239192] systemd[1]: Stopped target Initrd Default Target.572gitlab # [ 3.241879] systemd[1]: Stopped target Basic System.573gitlab # [ 3.243977] systemd[1]: Stopped target Initrd Root Device.574gitlab # [ 3.246203] systemd[1]: Stopped target Path Units.575gitlab # [ 3.248336] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.576gitlab # [ 3.251259] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.577gitlab # [ 3.254357] systemd[1]: Stopped target Slice Units.578gitlab # [ 3.256399] systemd[1]: Stopped target Socket Units.579gitlab # [ 3.258413] systemd[1]: Stopped target System Initialization.580gitlab # [ 3.261618] systemd[1]: Stopped target Swaps.581gitlab # [ 3.263593] systemd[1]: Stopped target Timer Units.582gitlab # [ 3.265561] systemd[1]: dbus.socket: Deactivated successfully.583gitlab # [ 3.267694] systemd[1]: Closed D-Bus System Message Bus Socket.584gitlab # [ 3.270147] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.585gitlab # [ 3.273955] systemd[1]: Stopped Find NixOS closure.586gitlab # [ 3.275541] systemd[1]: Starting Load Kernel Module 9pnet_virtio...587gitlab # [ 3.277726] systemd[1]: Starting rw-sysroot-nix-store.service...588gitlab # [ 3.279586] systemd[1]: systemd-sysctl.service: Deactivated successfully.589gitlab # [ 3.281742] systemd[1]: Stopped Apply Kernel Variables.590gitlab # [ 3.283503] systemd[1]: systemd-modules-load.service: Deactivated successfully.591gitlab # [ 3.285945] systemd[1]: Stopped Load Kernel Modules.592gitlab # [ 3.287529] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.593gitlab # [ 3.290145] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.594gitlab # [ 3.292611] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.595gitlab # [ 3.294696] systemd[1]: Stopped Create System Files and Directories.596gitlab # [ 3.296511] systemd[1]: Stopped target Local File Systems.597gitlab # [ 3.298015] systemd[1]: Stopped target Preparation for Local File Systems.598gitlab # [ 3.299806] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.599gitlab # [ 3.301760] systemd[1]: Stopped Coldplug All udev Devices.600gitlab # [ 3.303185] systemd[1]: Stopping Rule-based Manager for Device Events and Files...601gitlab # [ 3.305039] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.602gitlab # [ 3.306789] systemd[1]: Stopped Virtual Console Setup.603gitlab # [ 3.308234] systemd[1]: initrd-cleanup.service: Deactivated successfully.604gitlab # [ 3.309760] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.605gitlab # [ 3.311255] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.606gitlab # [ 3.312954] systemd[1]: Finished Load Kernel Module 9pnet_virtio.607gitlab # [ 3.314342] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.608gitlab # [ 3.315977] systemd[1]: Finished rw-sysroot-nix-store.service.609gitlab # [ 3.317338] systemd[1]: systemd-udevd.service: Deactivated successfully.610gitlab # [ 3.318891] systemd[1]: Stopped Rule-based Manager for Device Events and Files.611gitlab # [ 3.320757] systemd[1]: systemd-udevd.service: Consumed 2.366s CPU time over 1.589s wall clock time, 31.4M memory peak.612gitlab # [ 3.323077] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.613gitlab # [ 3.324739] systemd[1]: Closed udev Control Socket.614gitlab # [ 3.325897] systemd[1]: Starting Cleanup udev Database...615gitlab # [ 3.327161] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.616gitlab # [ 3.328945] systemd[1]: Stopped Create Static Device Nodes in /dev.617gitlab # [ 3.330356] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.618gitlab # [ 3.332161] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.619gitlab # [ 3.333743] systemd[1]: kmod-static-nodes.service: Deactivated successfully.620gitlab # [ 3.335232] systemd[1]: Stopped Create List of Static Device Nodes.621gitlab # [ 3.389909] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.622gitlab # [ 3.391630] systemd[1]: Finished Cleanup udev Database.623gitlab # [ 3.392891] systemd[1]: Reached target Switch Root.624gitlab # [ 3.395827] systemd[1]: Starting NixOS Activation...625gitlab # [ 3.579109] initrd-nixos-activation-start[224]: booting system configuration /nix/store/nkba7da9br4q97qjx52b46jx0nqfjr52-nixos-system-gitlab-test626gitlab # [ 3.654051] initrd-nixos-activation-start[224]: running activation script...627gitlab # [ 3.981899] initrd-nixos-activation-start[247]: setting up /etc...628gitlab # [ 4.155355] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.629gitlab # [ 4.158670] systemd[1]: Finished NixOS Activation.630gitlab # [ 4.160911] systemd[1]: Starting Switch Root...631gitlab # [ 4.207135] systemd[1]: Switching root.632gitlab # [ 4.306825] systemd-journald[94]: Received SIGTERM from PID 1 (systemd).633gitlab # [ 4.903539] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)634gitlab # [ 4.903664] systemd[1]: Detected virtualization qemu.635gitlab # [ 4.903748] systemd[1]: Detected architecture arm64.636gitlab # [ 4.903914] systemd[1]: Detected first boot.637gitlab # [ 4.905175] systemd[1]: Initializing machine ID from random generator.638gitlab # [ 5.275574] systemd[1]: bpf-restrict-fs: LSM BPF program attached639gitlab # [ 5.404652] systemd[1]: Applying preset policy.640gitlab # [ 5.622824] systemd[1]: Populated /etc with preset unit settings.641gitlab # [ 5.765484] systemd[1]: initrd-switch-root.service: Deactivated successfully.642gitlab # [ 5.765876] systemd[1]: Stopped initrd-switch-root.service.643gitlab # [ 5.768452] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.644gitlab # [ 5.773334] systemd[1]: Created slice Slice /system/getty.645gitlab # [ 5.780048] systemd[1]: Created slice GitLab DevOps Platform Slice.646gitlab # [ 5.783642] systemd[1]: Created slice User and Session Slice.647gitlab # [ 5.785075] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.648gitlab # [ 5.786435] systemd[1]: Started Forward Password Requests to Wall Directory Watch.649gitlab # [ 5.787610] systemd[1]: Expecting device /dev/hvc0...650gitlab # [ 5.788685] systemd[1]: Expecting device /dev/ttyAMA0...651gitlab # [ 5.789773] systemd[1]: Reached target Local Encrypted Volumes.652gitlab # [ 5.790908] systemd[1]: Stopped target initrd-fs.target.653gitlab # [ 5.791961] systemd[1]: Stopped target initrd-root-fs.target.654gitlab # [ 5.793003] systemd[1]: Stopped target initrd-switch-root.target.655gitlab # [ 5.794083] systemd[1]: Reached target Virtual Machines and Containers.656gitlab # [ 5.795185] systemd[1]: Reached target Path Units.657gitlab # [ 5.796216] systemd[1]: Reached target Remote File Systems.658gitlab # [ 5.797273] systemd[1]: Reached target Slice Units.659gitlab # [ 5.798328] systemd[1]: Reached target Swaps.660gitlab # [ 5.802285] systemd[1]: Listening on Query the User Interactively for a Password.661gitlab # [ 5.806477] systemd[1]: Listening on Process Core Dump Socket.662gitlab # [ 5.809578] systemd[1]: Listening on Credential Encryption/Decryption.663gitlab # [ 5.813248] systemd[1]: Listening on Factory Reset Management.664gitlab # [ 5.814589] systemd[1]: Listening on Hostname Service Socket.665gitlab # [ 5.823594] systemd[1]: Starting Journal Log Access Socket...666gitlab # [ 5.825719] systemd[1]: Listening on Journal Audit Socket.667gitlab # [ 5.829664] systemd[1]: Listening on Console Output Muting Service Socket.668gitlab # [ 5.831199] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.669gitlab # [ 5.832253] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os670gitlab # [ 5.833200] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki671gitlab # [ 5.839086] systemd[1]: Listening on Disk Repartitioning Service Socket.672gitlab # [ 5.840383] systemd[1]: Listening on udev Control Socket.673gitlab # [ 5.841685] systemd[1]: Listening on udev Varlink Socket.674gitlab # [ 5.875678] systemd[1]: Mounting Huge Pages File System...675gitlab # [ 5.880952] systemd[1]: Mounting POSIX Message Queue File System...676gitlab # [ 5.886722] systemd[1]: Mounting Kernel Debug File System...677gitlab # [ 5.894638] systemd[1]: Mounting Kernel Trace File System...678gitlab # [ 5.902534] systemd[1]: Starting Create List of Static Device Nodes...679gitlab # [ 5.915918] systemd[1]: Starting Load Kernel Module 9pnet_virtio...680gitlab # [ 5.920189] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs681gitlab # [ 5.935228] systemd[1]: Mounting Kernel Configuration File System...682gitlab # [ 5.938952] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm683gitlab # [ 5.941670] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore684gitlab # [ 5.948834] systemd[1]: Starting Load Kernel Module fuse...685gitlab # [ 5.949821] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67686gitlab # [ 5.960830] systemd[1]: Starting Journal Service...687gitlab # [ 5.965468] systemd[1]: Starting Load Kernel Modules...688gitlab # [ 5.972346] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...689gitlab # [ 5.981497] fuse: init (API version 7.45)690gitlab # [ 5.991181] systemd[1]: Starting Remount Root and Kernel File Systems...691gitlab # [ 5.992324] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os692gitlab # [ 6.005555] systemd[1]: Starting Coldplug All udev Devices...693gitlab # [ 6.014037] systemd[1]: Listening on Journal Log Access Socket.694gitlab # [ 6.018704] systemd[1]: Mounted Huge Pages File System.695gitlab # [ 6.019664] systemd[1]: Mounted POSIX Message Queue File System.696gitlab # [ 6.020396] systemd[1]: Mounted Kernel Debug File System.697gitlab # [ 6.021143] systemd[1]: Mounted Kernel Trace File System.698gitlab # [ 6.022238] systemd[1]: Finished Create List of Static Device Nodes.699gitlab # [ 6.022543] systemd-journald[318]: Collecting audit messages is enabled.700gitlab # [ 6.024656] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.701gitlab # [ 6.025486] systemd[1]: Finished Load Kernel Module 9pnet_virtio.702gitlab # [ 6.026240] systemd[1]: Mounted Kernel Configuration File System.703gitlab # [ 6.027115] systemd[1]: modprobe@fuse.service: Deactivated successfully.704gitlab # [ 6.043161] systemd[1]: Queued start job for default target Multi-User System.[ 6.027961] systemd[1]: Finished Load Kernel Module fuse.705gitlab # 706gitlab # [ 6.039014] systemd[1]: Mounting FUSE Control File System...707gitlab # [ 6.054315] systemd[1]: Unnecessary job was removed for /dev/vdb.708gitlab # [ 6.055656] systemd[1]: systemd-journald.service: Deactivated successfully.709gitlab # [ 6.057435] systemd-modules-load[319]: Using 3 probe threads710gitlab # [ 6.058625] systemd-modules-load[319]: Module 'atkbd' is built in711gitlab # [ 6.059869] systemd-modules-load[319]: Module 'loop' is built in712gitlab # [ 6.061127] systemd-modules-load[319]: Inserted module 'tls'713gitlab # [ 6.065880] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...714gitlab # [ 6.068042] systemd[1]: Started Journal Service.715gitlab # [ 6.068106] systemd[1]: Finished Load Kernel Modules.[ 6.071738] EXT4-fs (vda): re-mounted 379cd3c5-ff5b-42c1-bc0b-65f67746c799.716gitlab # 717gitlab # [ 6.074087] systemd[1]: Mounted FUSE Control File System.718gitlab # [ 6.076881] systemd[1]: Finished Remount Root and Kernel File Systems.719gitlab # [ 6.082858] systemd[1]: Listening on Disk Image Download Service Socket.720gitlab # [ 6.089448] systemd[1]: Starting Firewall...721gitlab # [ 6.094541] systemd-oomd[320]: No swap; memory pressure usage will be degraded722gitlab # [ 6.097923] systemd[1]: Starting Flush Journal to Persistent Storage...723gitlab # [ 6.099609] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore724gitlab # [ 6.104985] systemd[1]: Starting Load/Save OS Random Seed...725gitlab # [ 6.115234] systemd-journald[318]: Received client request to flush runtime journal.726gitlab # [ 6.142746] systemd[1]: Starting Apply Kernel Variables...727gitlab # [ 6.146126] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os728gitlab # [ 6.149354] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.729gitlab # [ 6.154062] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.730gitlab # [ 6.155368] systemd[1]: Starting Create Static Device Nodes in /dev...731gitlab # [ 6.157492] systemd[1]: Finished Load/Save OS Random Seed.732gitlab # [ 6.158351] systemd[1]: Reached target First Boot Complete.733gitlab # [ 6.159193] systemd[1]: Finished Apply Kernel Variables.734gitlab # [ 6.160443] systemd[1]: Finished Flush Journal to Persistent Storage.735gitlab # [ 6.161975] systemd[1]: Finished Create Static Device Nodes in /dev.736gitlab # [ 6.162915] systemd[1]: Reached target Preparation for Local File Systems.737gitlab # [ 6.163867] systemd[1]: Starting Rule-based Manager for Device Events and Files...738gitlab # [ 6.215212] systemd-udevd[355]: Using default interface naming scheme 'v261'.739gitlab # [ 6.244380] systemd[1]: Started Rule-based Manager for Device Events and Files.740gitlab # [ 6.575504] systemd[1]: Finished Firewall.741gitlab # [ 6.641153] systemd[1]: Finished Coldplug All udev Devices.742gitlab # [ 6.731926] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs743gitlab # [ 6.793110] systemd[1]: Mounting /run/wrappers...744gitlab # [ 6.799602] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.745gitlab # [ 6.822767] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.746gitlab # [ 6.827340] (udev-worker)[393]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.747gitlab # [ 6.831904] (udev-worker)[393]: Network interface NamePolicy= disabled on kernel command line.748gitlab # [ 6.836193] systemd[1]: Mounted /run/wrappers.749gitlab # [ 6.837885] systemd[1]: Reached target Local File Systems.750gitlab # [ 6.841084] systemd[1]: Listening on Boot Loader Control Service Socket.751gitlab # [ 6.846171] systemd[1]: Starting register-nix-paths.service...752gitlab # [ 6.847800] systemd[1]: Starting Create SUID/SGID Wrappers...753gitlab # [ 6.849672] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.754gitlab # [ 6.853781] systemd[1]: Starting Save Transient machine-id to Disk...755gitlab # [ 6.859490] systemd[1]: Starting Create System Files and Directories...756gitlab # [ 6.868342] systemd[1]: Condition check resulted in Virtio network device being skipped.757gitlab # [ 6.870421] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore758gitlab # [ 6.880182] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.759gitlab # [ 6.882511] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67760gitlab # [ 6.885160] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore761gitlab # [ 6.887469] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os762gitlab # [ 6.889643] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os763gitlab # [ 6.891858] (udev-worker)[397]: Network interface NamePolicy= disabled on kernel command line.764gitlab # [ 6.916076] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.765gitlab # [ 6.917282] systemd[1]: Finished Save Transient machine-id to Disk.766gitlab # [ 6.924557] systemd[1]: Finished Create System Files and Directories.767gitlab # [ 6.930144] systemd[1]: Starting Rebuild Journal Catalog...768gitlab # [ 6.932214] systemd[1]: Starting Record System Boot/Shutdown in UTMP...769gitlab # [ 6.957682] mousedev: PS/2 mouse device common for all mice770gitlab # [ 6.957173] systemd[1]: Finished Record System Boot/Shutdown in UTMP.771gitlab # [ 6.985569] systemd[1]: Finished Rebuild Journal Catalog.772gitlab # [ 7.019866] systemd[1]: Starting Update is Completed...773gitlab # [ 7.057127] systemd[1]: Finished Update is Completed.774gitlab # [ 7.064981] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.775gitlab # [ 7.067077] systemd[1]: Finished Create SUID/SGID Wrappers.776gitlab # [ 7.067985] systemd[1]: suid-sgid-wrappers.service: Consumed 143ms CPU time over 218ms wall clock time, 6.8M memory peak, 1.9M read from disk.777gitlab # [ 7.333338] systemd[1]: Finished register-nix-paths.service.778gitlab # [ 7.334361] systemd[1]: Reached target System Initialization.779gitlab # [ 7.335270] systemd[1]: Started Discard unused filesystem blocks once a week.780gitlab # [ 7.336341] systemd[1]: Started logrotate.timer.781gitlab # [ 7.337317] systemd[1]: Started Daily Cleanup of Temporary Directories.782gitlab # [ 7.338519] systemd[1]: Reached target Timer Units.783gitlab # [ 7.339571] systemd[1]: Listening on D-Bus System Message Bus Socket.784gitlab # [ 7.340738] systemd[1]: Listening on Nix Daemon Socket.785gitlab # [ 7.349395] systemd[1]: Starting nixbot CI service socket...786gitlab # [ 7.350583] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.787gitlab # [ 7.351841] systemd[1]: Listening on nixbot CI service socket.788gitlab # [ 7.352863] systemd[1]: Reached target Socket Units.789gitlab # [ 7.354466] systemd[1]: Starting D-Bus System Message Bus...790gitlab # [ 7.388134] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3791gitlab # [ 7.390779] dbus-broker-launch[561]: Looking up NSS user entry for 'systemd-timesync'...792gitlab # [ 7.392057] dbus-broker-launch[561]: NSS returned no entry for 'systemd-timesync'793gitlab # [ 7.393859] dbus-broker-launch[561]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"794gitlab # [ 7.397698] systemd[1]: Started D-Bus System Message Bus.795gitlab # [ 7.412460] dbus-broker-launch[561]: Ready796gitlab # [ 7.414682] systemd[1]: Reached target Basic System.797gitlab # [ 7.415524] systemd[1]: Started backdoor.service.798gitlab # [ 7.421273] systemd[1]: Starting gitlab-config.service...799gitlab # [ 7.425554] systemd[1]: Starting Import lastlog data into lastlog2 database...800gitlab # [ 7.452548] systemd[1]: Starting Logrotate configuration check...801gitlab # [ 7.455579] systemd[1]: Starting Name Service Cache Daemon (nsncd)...802gitlab # [ 7.460660] systemd[1]: Starting Post-Boot Actions...803gitlab # [ 7.468621] systemd[1]: Started Reset console on configuration changes.804gitlab # [ 7.480315] logrotate[568]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.805gitlab # connecting to host...806gitlab # [ 7.485715] logrotate[568]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf807gitlab # [ 7.487132] logrotate[568]: note: 'monthly' overrides previously specified 'weekly'808gitlab # [ 7.489834] logrotate[568]: Reading state from file: /var/lib/logrotate.status809gitlab # [ 7.491496] logrotate[568]: state file /var/lib/logrotate.status does not exist810gitlab: Guest shell says: b'Spawning backdoor root shell...\n'811gitlab # [ 7.495938] logrotate[568]: Allocating hash table for state file, size 64 entries812gitlab # [ 7.500121] logrotate[568]: Handling 4 logs813gitlab # [ 7.500845] logrotate[568]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed814gitlab # [ 7.502989] logrotate[568]: considering log /var/log/btmp815gitlab: connected to guest root shell816gitlab # [ 7.503758] logrotate[568]: Creating new state817gitlab: (connecting took 7.96 seconds)818gitlab # [ 7.512132] logrotate[568]: Now: 2026-09-06 15:20819gitlab: (finished: waiting for the VM to finish booting, in 7.96 seconds)820gitlab # [ 7.512857] logrotate[568]: Last rotated at 2026-09-06 15:00821gitlab # [ 7.513594] logrotate[568]: log does not need rotating (log has already been rotated)822gitlab # [ 7.514551] logrotate[568]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed823gitlab # [ 7.516689] logrotate[568]: considering log /var/log/wtmp824gitlab # [ 7.517448] logrotate[568]: Creating new state825gitlab # [ 7.518639] logrotate[568]: Now: 2026-09-06 15:20826gitlab # [ 7.519456] logrotate[568]: Last rotated at 2026-09-06 15:00827gitlab # [ 7.524557] logrotate[568]: log does not need rotating (log has already been rotated)828gitlab # [ 7.525661] logrotate[568]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed829gitlab # [ 7.527733] logrotate[568]: switching euid from 0 to 165 and egid from 0 to 165 (pid 568)830gitlab # [ 7.528953] logrotate[568]: considering log /var/gitlab/state/log/*.log831gitlab # [ 7.529825] logrotate[568]: log /var/gitlab/state/log/*.log does not exist -- skipping832gitlab # [ 7.530975] logrotate[568]: Creating new state833gitlab # [ 7.531646] logrotate[568]: switching euid from 165 to 0 and egid from 165 to 0 (pid 568)834gitlab # [ 7.535139] logrotate[568]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed835gitlab # [ 7.537344] logrotate[568]: switching euid from 0 to 60 and egid from 0 to 60 (pid 568)836gitlab # [ 7.539916] logrotate[568]: considering log /var/log/nginx/*.log837gitlab # [ 7.540874] logrotate[568]: log /var/log/nginx/*.log does not exist -- skipping838gitlab # [ 7.541925] logrotate[568]: Creating new state839gitlab # [ 7.542541] logrotate[568]: not running postrotate script, since no logs were rotated840gitlab # [ 7.543572] logrotate[568]: switching euid from 60 to 0 and egid from 60 to 0 (pid 568)841gitlab # [ 7.545953] nsncd[569]: Sep 06 15:20:23.374 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"842gitlab # [ 7.548845] systemd[1]: Starting resolvconf update...843gitlab # [ 7.549886] systemd[1]: Finished Logrotate configuration check.844gitlab # [ 7.550833] systemd[1]: Finished Post-Boot Actions.845gitlab # [ 7.552684] systemd[1]: Finished Import lastlog data into lastlog2 database.846gitlab # [ 7.553890] systemd[1]: Started Name Service Cache Daemon (nsncd).847gitlab # [ 7.554919] systemd[1]: Reached target Host and Network Name Lookups.848gitlab # [ 7.556003] systemd[1]: Reached target User and Group Name Lookups.849gitlab # [ 7.558343] systemd[1]: Starting User Login Management...850gitlab # [ 7.592732] systemd[1]: Starting Virtual Console Setup...851gitlab # [ 7.621065] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.852gitlab # [ 7.622206] systemd[1]: Stopped Virtual Console Setup.853gitlab # [ 7.623577] systemd[1]: Starting Virtual Console Setup...854gitlab # [ 7.629155] systemd-logind[608]: New seat seat0.855gitlab # [ 7.634236] systemd-logind[608]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)856gitlab # [ 7.635679] systemd-logind[608]: Watching system buttons on /dev/input/event0 (gpio-keys)857gitlab # [ 7.642377] systemd[1]: Started User Login Management.858gitlab # [ 7.643430] systemd[1]: Stopped target Host and Network Name Lookups.859gitlab # [ 7.647503] systemd[1]: Stopping Host and Network Name Lookups...860gitlab # [ 7.650321] systemd[1]: Stopped target User and Group Name Lookups.861gitlab # [ 7.652796] systemd[1]: Stopping User and Group Name Lookups...862gitlab # [ 7.653741] systemd[1]: Starting linger-users.service...863gitlab # [ 7.654670] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...864gitlab # [ 7.655608] systemd-logind[608]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)865gitlab # [ 7.657619] systemd[1]: nscd.service: Deactivated successfully.866gitlab # [ 7.658770] systemd[1]: Stopped Name Service Cache Daemon (nsncd).867gitlab # [ 7.659976] systemd[1]: nscd.service: Consumed 26ms CPU time over 194ms wall clock time, 7.2M memory peak, 5.8M read from disk.868gitlab # [ 7.662039] systemd[1]: linger-users.service: Deactivated successfully.869gitlab # [ 7.664125] systemd[1]: Finished linger-users.service.870gitlab # [ 7.665304] systemd[1]: Starting Name Service Cache Daemon (nsncd)...871gitlab # [ 7.685983] systemd-vconsole-setup[656]: Configuration of first virtual console was skipped, ignoring remaining ones.872gitlab # [ 7.688100] systemd[1]: Finished Virtual Console Setup.873gitlab # [ 7.694456] systemd[1]: Finished resolvconf update.874gitlab # [ 7.695270] systemd[1]: Reached target Preparation for Network.875gitlab # [ 7.696465] nsncd[667]: Sep 06 15:20:23.547 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"876gitlab # [ 7.700425] systemd[1]: Starting DHCP Client...877gitlab # [ 7.702632] systemd[1]: Starting Address configuration of eth1...878gitlab # [ 7.706646] systemd[1]: Starting Extra networking commands....879gitlab # [ 7.707688] systemd[1]: Started Name Service Cache Daemon (nsncd).880gitlab # [ 7.708792] systemd[1]: Reached target Host and Network Name Lookups.881gitlab # [ 7.709676] systemd[1]: Reached target User and Group Name Lookups.882gitlab # [ 7.755606] network-addresses-eth1-start[693]: adding address 192.168.1.1/24... done883gitlab # [ 7.761212] network-addresses-eth1-start[693]: adding address 2001:db8:1::1/64... done884gitlab # [ 7.768151] systemd[1]: Finished Address configuration of eth1.885gitlab # [ 7.802260] dhcpcd[702]: dhcpcd-10.3.2 starting886gitlab # [ 7.805041] dhcpcd[757]: dev: loaded udev887gitlab # [ 7.805733] systemd[1]: Finished Extra networking commands..888gitlab # [ 7.806522] systemd[1]: Reached target Network.889gitlab # [ 7.809185] systemd[1]: Starting gitlab-workhorse.service...890gitlab # [ 7.813307] systemd[1]: Starting Nginx Web Server...891gitlab # [ 7.819320] 8021q: 802.1Q VLAN Support v1.8892gitlab # [ 7.819695] 8021q: adding VLAN 0 to HW filter on device eth1893gitlab # [ 7.820618] systemd[1]: Starting PostgreSQL Server...894gitlab # [ 7.823604] systemd[1]: Starting Redis Server - redis-gitlab...895gitlab # [ 7.826819] systemd[1]: Starting Permit User Sessions...896gitlab # [ 7.833088] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.897gitlab # [ 7.860840] cfg80211: Loading compiled-in X.509 certificates for regulatory database898gitlab # [ 7.868183] systemd[1]: Finished Permit User Sessions.899gitlab # [ 7.878616] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'900gitlab # [ 7.876262] systemd[1]: Started Getty on tty1.901gitlab # [ 7.881813] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'902gitlab # [ 7.884417] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2903gitlab # [ 7.884769] cfg80211: failed to load regulatory.db904gitlab # [ 7.882435] systemd[1]: Reached target Login Prompts.905gitlab # [ 7.925914] 8021q: adding VLAN 0 to HW filter on device eth0906gitlab # [ 7.924611] dhcpcd[757]: eth0: waiting for carrier907gitlab # [ 7.926374] dhcpcd[757]: eth0: carrier acquired908gitlab # [ 7.930862] dhcpcd[757]: DUID 00:01:00:01:32:30:41:37:52:54:00:12:34:56909gitlab # [ 7.931934] dhcpcd[757]: eth0: IAID 00:12:34:56910gitlab # [ 7.933126] dhcpcd[757]: eth0: adding address fe80::5054:ff:fe12:3456911gitlab # [ 7.968379] nginx-pre-start[789]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok912gitlab # [ 7.971088] nginx-pre-start[789]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful913gitlab # [ 7.976320] systemd[1]: Started Nginx Web Server.914gitlab # [ 8.017874] redis-server[792]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.915gitlab # [ 8.020280] redis-server[792]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo916gitlab # [ 8.021767] redis-server[792]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=792, just started917gitlab # [ 8.023687] systemd[1]: Started Redis Server - redis-gitlab.918gitlab # [ 8.024622] redis-server[792]: Configuration loaded919gitlab # [ 8.025604] redis[792]: monotonic clock: ARM CNTVCT @ 1000 ticks/us920gitlab # [ 8.026707] redis[792]: Running mode=standalone, port=0.921gitlab # [ 8.027662] redis[792]: Server initialized922gitlab # [ 8.028498] redis[792]: Ready to accept connections unix923gitlab # [ 8.029414] redis[792]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.924gitlab # [ 8.039651] postgresql-pre-start[796]: The files belonging to this database system will be owned by user "postgres".925gitlab # [ 8.041868] postgresql-pre-start[796]: This user must also own the server process.926gitlab # [ 8.042938] postgresql-pre-start[796]: The database cluster will be initialized with locale "en_US.UTF-8".927gitlab # [ 8.044276] postgresql-pre-start[796]: The default database encoding has accordingly been set to "UTF8".928gitlab # [ 8.045612] postgresql-pre-start[796]: The default text search configuration will be set to "english".929gitlab # [ 8.046956] postgresql-pre-start[796]: Data page checksums are enabled.930gitlab # [ 8.048069] postgresql-pre-start[796]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok931gitlab # [ 8.049341] postgresql-pre-start[796]: creating subdirectories ... ok932gitlab # [ 8.050189] postgresql-pre-start[796]: selecting dynamic shared memory implementation ... posix933gitlab # [ 8.084804] postgresql-pre-start[796]: selecting default "max_connections" ... 100934gitlab # [ 8.133271] postgresql-pre-start[796]: selecting default "shared_buffers" ... 128MB935gitlab # [ 8.425443] systemd[1]: Started gitlab-workhorse.service.936gitlab # [ 8.598789] postgresql-pre-start[796]: selecting default time zone ... UTC937gitlab # [ 8.601598] postgresql-pre-start[796]: creating configuration files ... ok938gitlab # [ 8.625007] gitlab-workhorse[820]: time="2026-09-06T15:20:24Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4939gitlab # [ 8.626661] gitlab-workhorse[820]: time="2026-09-06T15:20:24Z" level=info msg="Using redis/go-redis"940gitlab # [ 8.627890] gitlab-workhorse[820]: time="2026-09-06T15:20:24Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix941gitlab # [ 8.828213] postgresql-pre-start[796]: running bootstrap script ... ok942gitlab # [ 9.066121] dhcpcd[757]: eth0: soliciting a DHCP lease943gitlab # [ 9.096832] dhcpcd[757]: eth0: offered 10.0.2.15 from 10.0.2.2944gitlab # [ 9.112485] dhcpcd[757]: eth0: probing address 10.0.2.15/24945gitlab # [ 9.557628] postgresql-pre-start[796]: performing post-bootstrap initialization ... ok946gitlab # [ 9.785306] dhcpcd[757]: eth0: soliciting an IPv6 router947gitlab # [ 9.789182] dhcpcd[757]: eth0: Router Advertisement from fe80::2948gitlab # [ 9.792939] dhcpcd[757]: eth0: adding address fec0::5054:ff:fe12:3456/64949gitlab # [ 9.796971] dhcpcd[757]: eth0: adding route to fec0::/64950gitlab # [ 9.800412] dhcpcd[757]: eth0: adding default route via fe80::2951gitlab # [ 9.885813] postgresql-pre-start[796]: syncing data to disk ... ok952gitlab # [ 9.888537] postgresql-pre-start[796]: initdb: warning: enabling "trust" authentication for local connections953gitlab # [ 9.892529] postgresql-pre-start[796]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.954gitlab # [ 9.898994] postgresql-pre-start[796]: Success. You can now start the database server using:955gitlab # [ 9.905386] postgresql-pre-start[796]: pg_ctl -D /var/lib/postgresql/18 -l logfile start956gitlab # [ 10.034839] postgres[853]: [853] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit957gitlab # [ 10.040684] postgres[853]: [853] LOG: listening on IPv6 address "::1", port 5432958gitlab # [ 10.044134] postgres[853]: [853] LOG: listening on IPv4 address "127.0.0.1", port 5432959gitlab # [ 10.047909] postgres[853]: [853] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"960gitlab # [ 10.050753] postgres[863]: [863] LOG: database system was shut down at 2026-09-06 15:20:25 GMT961gitlab # [ 10.060341] postgres[853]: [853] LOG: database system is ready to accept connections962gitlab # [ 10.063285] systemd[1]: Started PostgreSQL Server.963gitlab # [ 10.070412] systemd[1]: Starting PostgreSQL Setup Scripts...964gitlab # [ 10.272461] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[871]: mkdir -p /var/gitlab/state/home/.ssh: OK965gitlab # [ 10.276674] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[871]: chmod 700 /var/gitlab/state/home/.ssh: OK966gitlab # [ 10.383502] systemd[1]: Finished gitlab-config.service.967gitlab # [ 10.390239] systemd[1]: Started gitaly.service.968gitlab # [ 10.410516] postgresql-setup-start[879]: CREATE DATABASE969gitlab # [ 10.462192] postgresql-setup-start[898]: CREATE ROLE970gitlab # [ 10.487254] postgresql-setup-start[900]: ALTER DATABASE971gitlab # [ 10.539160] postgresql-setup-start[905]: CREATE ROLE972gitlab # [ 10.543665] systemd[1]: Finished PostgreSQL Setup Scripts.973gitlab # [ 10.546064] systemd[1]: Reached target PostgreSQL.974gitlab # [ 10.550242] systemd[1]: Starting gitlab-db-config.service...975gitlab # [ 10.556186] systemd[1]: Starting gitlab-postgresql.service...976gitlab # [ 10.748198] gitlab-postgresql-start[920]: CREATE DATABASE977gitlab # [ 10.825224] gitlab-postgresql-start[926]: CREATE EXTENSION978gitlab # [ 10.923586] gitlab-postgresql-start[937]: CREATE EXTENSION979gitlab # [ 10.927496] systemd[1]: Finished gitlab-postgresql.service.980gitlab # [ 11.013407] gitaly[893]: time="2026-09-06T15:20:26.865Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=893981gitlab # [ 11.033173] gitaly[893]: time="2026-09-06T15:20:26.865Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=893982gitlab # [ 11.037389] gitaly[893]: time="2026-09-06T15:20:26.865Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=893983gitlab # [ 11.042269] gitaly[893]: time="2026-09-06T15:20:26.865Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=893984gitlab # [ 11.046838] gitaly[893]: time="2026-09-06T15:20:26.865Z" level=info msg="Starting Gitaly" pid=893 version=985gitlab # [ 11.209281] gitaly[893]: time="2026-09-06T15:20:27.062Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=195 pid=893986gitlab # [ 11.211376] gitaly[893]: time="2026-09-06T15:20:27.064Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=893987gitlab # [ 11.213068] gitaly[893]: time="2026-09-06T15:20:27.064Z" level=info msg="finished initializing command factory" duration_ms=0 pid=893988gitlab # [ 11.214588] gitaly[893]: time="2026-09-06T15:20:27.064Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-893/git-exec-495795133.d/git pid=893989gitlab # [ 11.227414] gitaly[893]: time="2026-09-06T15:20:27.080Z" level=info msg="finished detecting git version" duration_ms=15 pid=893990gitlab # [ 11.229245] gitaly[893]: time="2026-09-06T15:20:27.080Z" level=info msg="using Git version" pid=893 version=2.53.g991gitlab # [ 11.233811] gitaly[893]: time="2026-09-06T15:20:27.085Z" level=info msg="clearing disk cache object folder" pid=893 storage=default992gitlab # [ 11.235589] gitaly[893]: time="2026-09-06T15:20:27.086Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache181733659 pid=893 storage=default993gitlab # [ 11.240636] gitaly[893]: time="2026-09-06T15:20:27.086Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache181733659 pid=893 storage=default994gitlab # [ 11.243572] gitaly[893]: time="2026-09-06T15:20:27.086Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=893995gitlab # [ 11.246119] gitaly[893]: time="2026-09-06T15:20:27.086Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=893996gitlab # [ 11.250083] gitaly[893]: time="2026-09-06T15:20:27.086Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache181733659 clear_duration_ms=0 pid=893 storage=default997gitlab # [ 11.254970] gitaly[893]: time="2026-09-06T15:20:27.108Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=893998gitlab # [ 11.258926] gitaly[893]: time="2026-09-06T15:20:27.108Z" level=info msg="counting repositories" pid=893999gitlab # [ 11.261266] gitaly[893]: time="2026-09-06T15:20:27.110Z" level=info msg="starting to count repositories" pid=893 storage_path=/var/gitlab/state/repositories1000gitlab # [ 11.263012] gitaly[893]: time="2026-09-06T15:20:27.108Z" level=info msg="finished tempdir cleaner walk" pid=893 storage=default time_ms=01001gitlab # [ 11.264725] gitaly[893]: time="2026-09-06T15:20:27.110Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=893 schema=unix1002gitlab # [ 11.266579] gitaly[893]: time="2026-09-06T15:20:27.110Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=893 storage_path=/var/gitlab/state/repositories1003gitlab # [ 11.268634] gitaly[893]: time="2026-09-06T15:20:27.110Z" level=info msg="completed counting all repositories" counting_duration=0 pid=8931004gitlab # [ 11.270161] gitaly[893]: time="2026-09-06T15:20:27.110Z" level=info msg="listening at address" address=/run/gitaly/gitaly-893/sock.d/intern pid=893 schema=unix1005gitlab # [ 11.271923] gitaly[893]: time="2026-09-06T15:20:27.111Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=8931006gitlab # [ 11.273581] gitaly[893]: time="2026-09-06T15:20:27.112Z" level=info msg="Started Gitaly" duration_ms=246 pid=8931007gitlab # [ 11.274879] gitaly[893]: time="2026-09-06T15:20:27.112Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=8931008gitlab # [ 11.276463] gitaly[893]: time="2026-09-06T15:20:27.112Z" level=info msg="maintenance: daily scheduled" pid=893 scheduled="2026-09-07 12:00:00 +0000 UTC"1009gitlab # [ 11.858712] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[910]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1010gitlab # [ 11.869328] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[910]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1011gitlab # [ 11.880350] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[910]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1012gitlab # [ 14.805854] dhcpcd[757]: eth0: leased 10.0.2.15 for 86400 seconds1013gitlab # [ 14.815417] dhcpcd[757]: eth0: adding route to 10.0.2.0/241014gitlab # [ 14.818440] dhcpcd[757]: eth0: adding default route via 10.0.2.21015gitlab # [ 14.852739] gitaly[893]: time="2026-09-06T15:20:30.704Z" level=info msg="License database preloaded" duration_ms=3838 pid=8931016gitlab # [ 15.254203] systemd[1]: Started DHCP Client.1017gitlab # [ 15.277982] systemd[1]: Reached target Network is Online.1018gitlab # [ 56.761191] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[910]: W, [2026-09-06T15:21:12.610607 #910] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1019gitlab # [ 58.687238] gitlab-workhorse[820]: time="2026-09-06T15:21:14Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1020gitlab # [ 59.781623] postgres[1428]: [1428] ERROR: relation "feature_gates" does not exist at character 5231021gitlab # [ 59.781836] postgres[1428]: [1428] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1022gitlab # [ 59.781894] postgres[1428]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1023gitlab # [ 59.781935] postgres[1428]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1024gitlab # [ 59.781967] postgres[1428]: attidentity AS identity,1025gitlab # [ 59.782003] postgres[1428]: attgenerated as attgenerated1026gitlab # [ 59.782040] postgres[1428]: FROM pg_attribute a1027gitlab # [ 59.782079] postgres[1428]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1028gitlab # [ 59.782118] postgres[1428]: LEFT JOIN pg_type t ON a.atttypid = t.oid1029gitlab # [ 59.782155] postgres[1428]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1030gitlab # [ 59.782191] postgres[1428]: WHERE a.attrelid = '"feature_gates"'::regclass1031gitlab # [ 59.782238] postgres[1428]: AND a.attnum > 0 AND NOT a.attisdropped1032gitlab # [ 59.782278] postgres[1428]: ORDER BY a.attnum1033gitlab # [ 59.782316] postgres[1428]:1034gitlab # [ 64.795690] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1479]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1035gitlab # [ 64.796165] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1479]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1036gitlab # [ 68.696981] gitlab-workhorse[820]: time="2026-09-06T15:21:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1037gitlab # [ 78.706328] gitlab-workhorse[820]: time="2026-09-06T15:21:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1038gitlab # [ 88.716886] gitlab-workhorse[820]: time="2026-09-06T15:21:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1039gitlab # [ 91.242033] postgres[1582]: [1582] ERROR: relation "table_without_models" does not exist1040gitlab # [ 91.242421] postgres[1582]: [1582] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1041gitlab # [ 98.727269] gitlab-workhorse[820]: time="2026-09-06T15:21:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1042gitlab # [ 108.737215] gitlab-workhorse[820]: time="2026-09-06T15:22:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1043gitlab # [ 118.746360] gitlab-workhorse[820]: time="2026-09-06T15:22:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1044gitlab # [ 120.990653] systemd[1]: Finished gitlab-db-config.service.1045gitlab # [ 120.998122] systemd[1]: Started gitlab-sidekiq.service.1046gitlab # [ 121.004249] systemd[1]: Starting gitlab.service...1047gitlab # [ 121.605752] bundle[1957]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1048gitlab # [ 121.612102] bundle[1957]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1049gitlab # [ 121.618103] bundle[1957]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1050gitlab # [ 126.019295] sidekiq-cluster[1956]: {"severity":"INFO","time":"2026-09-06T15:22:21.843Z","message":"Starting cluster with 1 processes"}1051gitlab # [ 126.118021] bundle[1957]: {"timestamp":"2026-09-06T15:22:21.943Z","pid":1957,"message":"* Enabling systemd notification integration"}1052gitlab # [ 126.123039] bundle[1957]: {"timestamp":"2026-09-06T15:22:21.970Z","pid":1957,"message":"Puma starting in cluster mode..."}1053gitlab # [ 126.127609] bundle[1957]: {"timestamp":"2026-09-06T15:22:21.970Z","pid":1957,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1054gitlab # [ 126.132475] bundle[1957]: {"timestamp":"2026-09-06T15:22:21.970Z","pid":1957,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1055gitlab # [ 126.138405] bundle[1957]: {"timestamp":"2026-09-06T15:22:21.970Z","pid":1957,"message":"* Min threads: 0"}1056gitlab # [ 126.142830] bundle[1957]: {"timestamp":"2026-09-06T15:22:21.970Z","pid":1957,"message":"* Max threads: 4"}1057gitlab # [ 126.147022] bundle[1957]: {"timestamp":"2026-09-06T15:22:21.970Z","pid":1957,"message":"* Environment: production"}1058gitlab # [ 126.151783] bundle[1957]: {"timestamp":"2026-09-06T15:22:21.970Z","pid":1957,"message":"* Master PID: 1957"}1059gitlab # [ 126.156464] bundle[1957]: {"timestamp":"2026-09-06T15:22:21.970Z","pid":1957,"message":"* Workers: 2"}1060gitlab # [ 126.160608] bundle[1957]: {"timestamp":"2026-09-06T15:22:21.970Z","pid":1957,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1061gitlab # [ 126.166247] bundle[1957]: {"timestamp":"2026-09-06T15:22:21.970Z","pid":1957,"message":"* Preloading application"}1062gitlab # [ 128.750736] gitlab-workhorse[820]: time="2026-09-06T15:22:24Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1063gitlab # [ 138.753853] gitlab-workhorse[820]: time="2026-09-06T15:22:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1064gitlab # [ 148.762267] gitlab-workhorse[820]: time="2026-09-06T15:22:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1065gitlab # [ 158.763295] gitlab-workhorse[820]: time="2026-09-06T15:22:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1066gitlab # [ 162.308223] bundle[1957]: W, [2026-09-06T15:22:58.160015 #1957] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1067gitlab # [ 167.233021] sidekiq-cluster[2006]: 2026-09-06T15:23:03.084Z pid=2006 tid=wou INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2006, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>425852928}1068gitlab # [ 167.506935] sidekiq-cluster[2006]: W, [2026-09-06T15:23:03.359896 #2006] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1069gitlab # [ 167.650910] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:03.503Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1070gitlab # [ 168.781875] gitlab-workhorse[820]: time="2026-09-06T15:23:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1071gitlab # [ 170.828159] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.679Z","message":"GitLab reliable fetch activated!"}1072gitlab # [ 170.828588] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.680Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1073gitlab # [ 170.872930] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.725Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1074gitlab # [ 170.880039] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.731Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1075gitlab # [ 170.887053] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.738Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1076gitlab # [ 170.893747] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.744Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1077gitlab # [ 170.901109] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.750Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1078gitlab # [ 170.907772] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.755Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1079gitlab # [ 170.914654] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.759Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1080gitlab # [ 170.920584] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.762Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1081gitlab # [ 170.925782] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.765Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1082gitlab # [ 170.930590] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.768Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1083gitlab # [ 170.935873] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.770Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1084gitlab # [ 170.940653] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.774Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1085gitlab # [ 170.944560] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.777Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1086gitlab # [ 170.948511] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.780Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1087gitlab # [ 170.952194] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.783Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1088gitlab # [ 170.955713] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.786Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1089gitlab # [ 170.959091] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.789Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1090gitlab # [ 170.962264] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.793Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1091gitlab # [ 170.965584] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.797Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1092gitlab # [ 170.968515] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.801Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1093gitlab # [ 170.971637] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.805Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1094gitlab # [ 170.975905] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.808Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1095gitlab # [ 170.978799] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.811Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1096gitlab # [ 170.981693] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.814Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1097gitlab # [ 170.984559] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.817Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1098gitlab # [ 170.987264] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.821Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1099gitlab # [ 170.989992] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.824Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1100gitlab # [ 170.992697] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.828Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1101gitlab # [ 170.995414] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.830Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1102gitlab # [ 170.998310] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.834Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1103gitlab # [ 171.000916] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.837Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1104gitlab # [ 171.014384] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.867Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1105gitlab # [ 171.025149] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.878Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1106gitlab # [ 171.030798] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.883Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1107gitlab # [ 171.035272] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.888Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1108gitlab # [ 171.039795] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.891Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1109gitlab # [ 171.044178] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.895Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1110gitlab # [ 171.047918] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.900Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1111gitlab # [ 171.051636] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.903Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1112gitlab # [ 171.055139] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.906Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1113gitlab # [ 171.058709] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.910Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1114gitlab # [ 171.062047] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.913Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1115gitlab # [ 171.065269] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.916Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1116gitlab # [ 171.068356] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.920Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1117gitlab # [ 171.071893] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.924Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1118gitlab # [ 171.075463] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.928Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1119gitlab # [ 171.078675] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.931Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1120gitlab # [ 171.081991] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.935Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1121gitlab # [ 171.084839] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.937Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1122gitlab # [ 171.087655] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.940Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1123gitlab # [ 171.090708] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.943Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1124gitlab # [ 171.093578] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.946Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1125gitlab # [ 171.109072] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.962Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1126gitlab # [ 171.112678] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.965Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1127gitlab # [ 171.115879] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.968Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1128gitlab # [ 171.119233] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.971Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1129gitlab # [ 171.122558] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.973Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1130gitlab # [ 171.126031] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.976Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1131gitlab # [ 171.129333] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.979Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1132gitlab # [ 171.132524] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.981Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1133gitlab # [ 171.135269] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.983Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1134gitlab # [ 171.138120] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:06.985Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1135gitlab # [ 171.207952] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.060Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1136gitlab # [ 171.214724] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.064Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1137gitlab # [ 171.221618] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.067Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1138gitlab # [ 171.228319] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.071Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1139gitlab # [ 171.234538] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.073Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1140gitlab # [ 171.240406] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.076Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1141gitlab # [ 171.245879] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.078Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1142gitlab # [ 171.251229] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.081Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1143gitlab # [ 171.255978] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.083Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1144gitlab # [ 171.260260] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.086Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1145gitlab # [ 171.264274] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.088Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1146gitlab # [ 171.268292] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.090Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1147gitlab # [ 171.272089] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.092Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1148gitlab # [ 171.275787] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.095Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1149gitlab # [ 171.279220] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.097Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1150gitlab # [ 171.282977] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.099Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1151gitlab # [ 171.286322] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.102Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1152gitlab # [ 171.289529] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.104Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1153gitlab # [ 171.293008] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.106Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1154gitlab # [ 171.296548] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.108Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1155gitlab # [ 171.299858] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.112Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1156gitlab # [ 171.303239] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.114Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1157gitlab # [ 171.306794] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.117Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1158gitlab # [ 171.310146] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.119Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1159gitlab # [ 171.313669] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.122Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1160gitlab # [ 171.316767] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.124Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1161gitlab # [ 171.319822] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.127Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1162gitlab # [ 171.323035] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.132Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1163gitlab # [ 171.326161] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.137Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1164gitlab # [ 171.329141] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.144Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1165gitlab # [ 171.332107] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.146Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1166gitlab # [ 171.335227] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.149Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1167gitlab # [ 171.337945] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.152Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1168gitlab # [ 171.341013] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.156Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1169gitlab # [ 171.343918] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.161Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1170gitlab # [ 171.346987] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.163Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1171gitlab # [ 171.349935] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.178Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1172gitlab # [ 171.352748] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.184Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1173gitlab # [ 171.355394] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.188Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1174gitlab # [ 171.358216] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.191Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1175gitlab # [ 171.360671] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.195Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1176gitlab # [ 171.363093] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.200Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1177gitlab # [ 171.365798] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.203Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1178gitlab # [ 171.368412] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.205Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1179gitlab # [ 171.370721] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.212Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1180gitlab # [ 171.373236] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.216Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1181gitlab # [ 171.375606] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:07.218Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1182gitlab # [ 178.792594] gitlab-workhorse[820]: time="2026-09-06T15:23:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1183gitlab # [ 188.792222] gitlab-workhorse[820]: time="2026-09-06T15:23:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1184gitlab # [ 198.797989] gitlab-workhorse[820]: time="2026-09-06T15:23:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1185gitlab # [ 208.806402] gitlab-workhorse[820]: time="2026-09-06T15:23:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1186gitlab # [ 209.491179] postgres[2708]: [2708] ERROR: relation "table_without_models" does not exist1187gitlab # [ 209.494009] postgres[2708]: [2708] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1188gitlab # [ 212.603898] postgres[2737]: [2737] ERROR: relation "table_without_models" does not exist1189gitlab # [ 212.607555] postgres[2737]: [2737] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1190gitlab # [ 214.479404] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:50.331Z","message":"Booted Rails 7.2.3.1 application in production environment"}1191gitlab # [ 214.482313] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:50.334Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1192gitlab # [ 214.484362] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:50.334Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1193gitlab # [ 214.492250] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:50.334Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1194gitlab # [ 214.494352] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:50.340Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1195gitlab # [ 217.122937] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:52.974Z","message":"Cleaning working queues"}1196gitlab # [ 217.127774] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:52.976Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"e65738eb479449e7e78f4c02","created_at":"2026-09-06T15:22:16.275Z","trace_propagation_headers":{"sentry-trace":"d5418667e66244c49c430d0e41256dce-886ee3d5760c4233","baggage":"sentry-trace_id=d5418667e66244c49c430d0e41256dce,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"72da2974955f100401d056a50b352089","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-06T15:22:16.286Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-e65738eb479449e7e78f4c02: start","job_status":"start","queue_duration_s":96.689563,"scheduling_latency_s":96.689613}1197gitlab # [ 217.410585] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:23:53.262Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"e65738eb479449e7e78f4c02","created_at":"2026-09-06T15:22:16.275Z","trace_propagation_headers":{"sentry-trace":"d5418667e66244c49c430d0e41256dce-886ee3d5760c4233","baggage":"sentry-trace_id=d5418667e66244c49c430d0e41256dce,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"72da2974955f100401d056a50b352089","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-06T15:22:16.286Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-e65738eb479449e7e78f4c02: done: 0.286366 sec","job_status":"done","queue_duration_s":96.689563,"scheduling_latency_s":96.689613,"redis_calls":29,"redis_duration_s":0.006763,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.003403,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002204,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001156,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.132658,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.13410522,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.286366,"completed_at":"2026-09-06T15:23:53.262Z","load_balancing_strategy":"primary","db_duration_s":0.073334,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1198gitlab # [ 218.156896] bundle[1957]: {"timestamp":"2026-09-06T15:23:54.008Z","pid":1957,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1199gitlab # [ 218.157246] bundle[1957]: {"timestamp":"2026-09-06T15:23:54.008Z","pid":1957,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1200gitlab # [ 218.157373] bundle[1957]: {"timestamp":"2026-09-06T15:23:54.008Z","pid":1957,"message":"! #\u003cThread:0x0000e4e87fe8e3b8 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1201gitlab # [ 218.157527] bundle[1957]: {"timestamp":"2026-09-06T15:23:54.008Z","pid":1957,"message":"! #\u003cThread:0x0000e4e88006b898 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1202gitlab # [ 218.157646] bundle[1957]: {"timestamp":"2026-09-06T15:23:54.009Z","pid":1957,"message":"Use Ctrl-C to stop"}1203gitlab # [ 218.157757] bundle[1957]: {"timestamp":"2026-09-06T15:23:54.009Z","pid":1957,"message":"Sending status to systemd every 1.0 sec"}1204gitlab # [ 218.736229] bundle[1957]: {"timestamp":"2026-09-06T15:23:54.589Z","pid":1957,"message":"- Worker 0 (PID: 2837) booted in 0.54s, phase: 0"}1205gitlab # [ 218.752446] bundle[1957]: {"timestamp":"2026-09-06T15:23:54.605Z","pid":1957,"message":"- Worker 1 (PID: 2845) booted in 0.54s, phase: 0"}1206gitlab # [ 218.757615] systemd[1]: Started gitlab.service.1207gitlab # [ 218.758380] systemd[1]: Reached target Common target for all GitLab services..1208gitlab # [ 218.763725] systemd[1]: Starting setup-gitlab.service...1209gitlab # [ 218.820720] setup-gitlab-start[2874]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1210gitlab # [ 222.458220] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:23:58 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 35861211gitlab # [ 222.467470] setup-gitlab-start[2874]: + TOKEN=nixbot-test-token-of-20-chars1212gitlab # [ 222.468610] setup-gitlab-start[2874]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1213gitlab # [ 222.485026] runuser[2904]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1214gitlab # [ 223.045598] setup-gitlab-start[2905]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1215gitlab # [ 223.052157] setup-gitlab-start[2905]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1216gitlab # [ 223.058382] setup-gitlab-start[2905]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1217gitlab # [ 223.868658] setup-gitlab-start[2905]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1218gitlab # [ 223.869021] setup-gitlab-start[2905]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1219gitlab # [ 223.871293] setup-gitlab-start[2905]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1220gitlab # [ 227.954367] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:03.805Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"b149842fca3ee5c7e5d790a8","created_at":"2026-09-06T15:24:03.701Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"849579187643c0c0b276a8d7ce73c01e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:03.800Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-b149842fca3ee5c7e5d790a8: start","job_status":"start","queue_duration_s":0.004386,"scheduling_latency_s":0.004503}1221gitlab # [ 228.171302] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:04.022Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"b149842fca3ee5c7e5d790a8","created_at":"2026-09-06T15:24:03.701Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"849579187643c0c0b276a8d7ce73c01e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:03.800Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-b149842fca3ee5c7e5d790a8: done: 0.21747 sec","job_status":"done","queue_duration_s":0.004386,"scheduling_latency_s":0.004503,"redis_calls":12,"redis_duration_s":0.023861,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003556,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.013033,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.007272,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.061608,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00512988,"exclusive_lock_hold_duration_s":0.038419299999999997,"duration_s":0.21747,"completed_at":"2026-09-06T15:24:04.022Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.070002,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1222gitlab # [ 228.250021] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:04.081Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Environments::AutoStopCronWorker","jid":"ec9f3ab4bea96bd9450e7a16","created_at":"2026-09-06T15:24:03.819Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f4184a3693bacf7aec166e86651a665","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_delivery","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:037d6a92006e3beb0e73d758a3f9a2a2a104eaa8b9d3c2b1a2cf37915906a513","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:03.857Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Environments::AutoStopCronWorker JID-ec9f3ab4bea96bd9450e7a16: start","job_status":"start","queue_duration_s":0.223498,"scheduling_latency_s":0.223554}1223gitlab # [ 228.378180] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:04.230Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Environments::AutoStopCronWorker","jid":"ec9f3ab4bea96bd9450e7a16","created_at":"2026-09-06T15:24:03.819Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f4184a3693bacf7aec166e86651a665","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_delivery","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:037d6a92006e3beb0e73d758a3f9a2a2a104eaa8b9d3c2b1a2cf37915906a513","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:03.857Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Environments::AutoStopCronWorker JID-ec9f3ab4bea96bd9450e7a16: done: 0.149228 sec","job_status":"done","queue_duration_s":0.223498,"scheduling_latency_s":0.223554,"redis_calls":12,"redis_duration_s":0.016993,"redis_read_bytes":11,"redis_write_bytes":1368,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001605,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008857,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.006531,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":503,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047559,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00239904,"exclusive_lock_hold_duration_s":0.02561446,"duration_s":0.149228,"completed_at":"2026-09-06T15:24:04.229Z","load_balancing_strategy":"primary","db_duration_s":0.011341,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1224gitlab # [ 228.462699] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:04.239Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"d43ca70ec7b4c0cbd67c1e99","created_at":"2026-09-06T15:24:03.883Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6609cc34785aefaddd1c3da17ae130d7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:03.903Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-d43ca70ec7b4c0cbd67c1e99: start","job_status":"start","queue_duration_s":0.336043,"scheduling_latency_s":0.336091}1225gitlab # [ 228.479805] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:04.279Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1226gitlab # [ 228.483411] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:04.331Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"d43ca70ec7b4c0cbd67c1e99","created_at":"2026-09-06T15:24:03.883Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6609cc34785aefaddd1c3da17ae130d7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:03.903Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-d43ca70ec7b4c0cbd67c1e99: done: 0.092474 sec","job_status":"done","queue_duration_s":0.336043,"scheduling_latency_s":0.336091,"redis_calls":10,"redis_duration_s":0.0035730000000000002,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000738,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002102,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000733,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031909,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00069544,"duration_s":0.092474,"completed_at":"2026-09-06T15:24:04.331Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001658,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1227gitlab # [ 228.526583] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:04.338Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"d3b4dd8420cef0f0b28dd7b8","created_at":"2026-09-06T15:24:03.939Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3ef5ddead256f25af1d179540f1659bb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:03.961Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-d3b4dd8420cef0f0b28dd7b8: start","job_status":"start","queue_duration_s":0.3776,"scheduling_latency_s":0.377645}1228gitlab # [ 228.581276] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:04.434Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1229gitlab # [ 228.612114] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:04.463Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"d3b4dd8420cef0f0b28dd7b8","created_at":"2026-09-06T15:24:03.939Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3ef5ddead256f25af1d179540f1659bb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:03.961Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-d3b4dd8420cef0f0b28dd7b8: done: 0.124864 sec","job_status":"done","queue_duration_s":0.3776,"scheduling_latency_s":0.377645,"redis_calls":10,"redis_duration_s":0.005357000000000001,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00186,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002733,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000764,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033205,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00072628,"duration_s":0.124864,"completed_at":"2026-09-06T15:24:04.463Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.033622,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1230gitlab # [ 228.690724] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:04.474Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b02132238947a1cab97a0372","created_at":"2026-09-06T15:24:03.985Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"26b092628a12af8af18bfb36538bed58","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.018Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b02132238947a1cab97a0372: start","job_status":"start","queue_duration_s":0.455148,"scheduling_latency_s":0.455194}1231gitlab # [ 229.059782] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:04.910Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b02132238947a1cab97a0372","created_at":"2026-09-06T15:24:03.985Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"26b092628a12af8af18bfb36538bed58","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.018Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b02132238947a1cab97a0372: done: 0.436278 sec","job_status":"done","queue_duration_s":0.455148,"scheduling_latency_s":0.455194,"redis_calls":12,"redis_duration_s":0.016241,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00146,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007549,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.007232,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.093,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.093,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.147248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0048363,"exclusive_lock_hold_duration_s":0.24157628,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.436278,"completed_at":"2026-09-06T15:24:04.910Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.101614,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1232gitlab # [ 229.145186] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:04.914Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"94bdf1e2efa60bded5fd6365","created_at":"2026-09-06T15:24:04.046Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"720580e101a01dd28e7dccd440f7d8b8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.058Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-94bdf1e2efa60bded5fd6365: start","job_status":"start","queue_duration_s":0.855624,"scheduling_latency_s":0.855675}1233gitlab # [ 229.276138] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:05.127Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"94bdf1e2efa60bded5fd6365","created_at":"2026-09-06T15:24:04.046Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"720580e101a01dd28e7dccd440f7d8b8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.058Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-94bdf1e2efa60bded5fd6365: done: 0.213308 sec","job_status":"done","queue_duration_s":0.855624,"scheduling_latency_s":0.855675,"redis_calls":14,"redis_duration_s":0.012513999999999999,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004873,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004703,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002938,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.071,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.056,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.070686,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0026287,"exclusive_lock_hold_duration_s":0.12080258,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.213308,"completed_at":"2026-09-06T15:24:05.127Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.083574,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1234gitlab # [ 229.362902] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:05.132Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"1fe0558a23df1fa918cf2ff9","created_at":"2026-09-06T15:24:04.070Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"67dc7bc3a16dff740a4676325238bde6","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.087Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-1fe0558a23df1fa918cf2ff9: start","job_status":"start","queue_duration_s":1.044396,"scheduling_latency_s":1.044443}1235gitlab # [ 229.921367] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:05.773Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"1fe0558a23df1fa918cf2ff9","created_at":"2026-09-06T15:24:04.070Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"67dc7bc3a16dff740a4676325238bde6","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.087Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-1fe0558a23df1fa918cf2ff9: done: 0.641787 sec","job_status":"done","queue_duration_s":1.044396,"scheduling_latency_s":1.044443,"redis_calls":565,"redis_duration_s":0.187073,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000677,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001457,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.184939,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.495053,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026348,"duration_s":0.641787,"completed_at":"2026-09-06T15:24:05.773Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003346,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1236gitlab # [ 230.019477] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:05.775Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"1492e130eae1666797552062","created_at":"2026-09-06T15:24:04.144Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a704c05a04788d588c91d33b05bb3700","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.164Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-1492e130eae1666797552062: start","job_status":"start","queue_duration_s":1.610891,"scheduling_latency_s":1.61091}1237gitlab # [ 230.038340] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:05.805Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"1492e130eae1666797552062","created_at":"2026-09-06T15:24:04.144Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a704c05a04788d588c91d33b05bb3700","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.164Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-1492e130eae1666797552062: done: 0.030184 sec","job_status":"done","queue_duration_s":1.610891,"scheduling_latency_s":1.61091,"redis_calls":10,"redis_duration_s":0.001565,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000327,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000918,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00032,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00046564,"duration_s":0.030184,"completed_at":"2026-09-06T15:24:05.805Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004903,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1238gitlab # [ 230.082298] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:05.807Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"ce124b632aebc84494538f28","created_at":"2026-09-06T15:24:04.226Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"581c9fb02ae8e0977cc2f858b361d6ff","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.245Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-ce124b632aebc84494538f28: start","job_status":"start","queue_duration_s":1.561066,"scheduling_latency_s":1.561085}1239gitlab # [ 230.097023] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:05.820Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1240gitlab # [ 230.100785] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:05.828Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"ce124b632aebc84494538f28","created_at":"2026-09-06T15:24:04.226Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"581c9fb02ae8e0977cc2f858b361d6ff","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.245Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-ce124b632aebc84494538f28: done: 0.021444 sec","job_status":"done","queue_duration_s":1.561066,"scheduling_latency_s":1.561085,"redis_calls":10,"redis_duration_s":0.001578,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000332,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000321,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012724,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002636,"duration_s":0.021444,"completed_at":"2026-09-06T15:24:05.828Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000643,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1241gitlab # [ 230.142316] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:05.829Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"c57173bacfd6eb7d7409f164","created_at":"2026-09-06T15:24:04.318Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"db86527fd8a51bf3b8309e85659b8045","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.335Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-c57173bacfd6eb7d7409f164: start","job_status":"start","queue_duration_s":1.493995,"scheduling_latency_s":1.494012}1242gitlab # [ 230.156074] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:05.862Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"c57173bacfd6eb7d7409f164","created_at":"2026-09-06T15:24:04.318Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"db86527fd8a51bf3b8309e85659b8045","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.335Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-c57173bacfd6eb7d7409f164: done: 0.032883 sec","job_status":"done","queue_duration_s":1.493995,"scheduling_latency_s":1.494012,"redis_calls":12,"redis_duration_s":0.002161,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000513,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000872,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000776,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019255,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00058932,"exclusive_lock_hold_duration_s":0.01037696,"duration_s":0.032883,"completed_at":"2026-09-06T15:24:05.862Z","load_balancing_strategy":"primary","db_duration_s":0.005916,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1243gitlab # [ 230.197938] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:05.864Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"235476f93b438587a018db48","created_at":"2026-09-06T15:24:04.353Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9b1e5462a850210c1755de25fe432303","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.364Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-235476f93b438587a018db48: start","job_status":"start","queue_duration_s":1.499176,"scheduling_latency_s":1.499194}1244gitlab # [ 230.211209] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:05.904Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"235476f93b438587a018db48","created_at":"2026-09-06T15:24:04.353Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9b1e5462a850210c1755de25fe432303","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.364Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-235476f93b438587a018db48: done: 0.040754 sec","job_status":"done","queue_duration_s":1.499176,"scheduling_latency_s":1.499194,"redis_calls":19,"redis_duration_s":0.003035,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000721,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000242,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.001558,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000514,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029194,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026552,"duration_s":0.040754,"completed_at":"2026-09-06T15:24:05.904Z","load_balancing_strategy":"primary","db_duration_s":0.003181,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1245gitlab # [ 230.254034] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:05.906Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"247e7c133ef7f61c1b5377d1","created_at":"2026-09-06T15:24:04.431Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6158dff74d2c19c1b53512e978be152a","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.469Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-247e7c133ef7f61c1b5377d1: start","job_status":"start","queue_duration_s":1.437011,"scheduling_latency_s":1.437029}1246gitlab # [ 230.268193] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:05.951Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"247e7c133ef7f61c1b5377d1","created_at":"2026-09-06T15:24:04.431Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6158dff74d2c19c1b53512e978be152a","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.469Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-247e7c133ef7f61c1b5377d1: done: 0.045321 sec","job_status":"done","queue_duration_s":1.437011,"scheduling_latency_s":1.437029,"redis_calls":16,"redis_duration_s":0.002474,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001336,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000835,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000303,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00050392,"duration_s":0.045321,"completed_at":"2026-09-06T15:24:05.951Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015905,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1247gitlab # [ 230.309319] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:05.953Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"8cf9ed4a2caf81cd383d8420","created_at":"2026-09-06T15:24:04.507Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c62fd659c8818a71d835d43917634c1d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-06T15:24:04.516Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-8cf9ed4a2caf81cd383d8420: start","job_status":"start","queue_duration_s":1.436223,"scheduling_latency_s":1.436272}1248gitlab # [ 230.322330] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:05.966Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1249gitlab # [ 230.326099] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:05.973Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"8cf9ed4a2caf81cd383d8420","created_at":"2026-09-06T15:24:04.507Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c62fd659c8818a71d835d43917634c1d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-06T15:24:04.516Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-8cf9ed4a2caf81cd383d8420: done: 0.020554 sec","job_status":"done","queue_duration_s":1.436223,"scheduling_latency_s":1.436272,"redis_calls":10,"redis_duration_s":0.001446,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00033,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000805,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000311,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012308,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002452,"duration_s":0.020554,"completed_at":"2026-09-06T15:24:05.973Z","load_balancing_strategy":"primary","db_duration_s":0.000587,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1250gitlab # [ 230.367250] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:05.974Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::JiraImport::StuckJiraImportJobsWorker","jid":"c38a5a4e80b3f154235ce410","created_at":"2026-09-06T15:24:04.527Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"53ba9e5b3fc7e9811f4b52a0a61476c3","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b9cf6c9b6c2f8fad80e08693d59af787bb65ad6ffe24ec5d0e1a669517566127","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.570Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::JiraImport::StuckJiraImportJobsWorker JID-c38a5a4e80b3f154235ce410: start","job_status":"start","queue_duration_s":1.403874,"scheduling_latency_s":1.403891}1251gitlab # [ 230.382442] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.019Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::JiraImport::StuckJiraImportJobsWorker","jid":"c38a5a4e80b3f154235ce410","created_at":"2026-09-06T15:24:04.527Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"53ba9e5b3fc7e9811f4b52a0a61476c3","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b9cf6c9b6c2f8fad80e08693d59af787bb65ad6ffe24ec5d0e1a669517566127","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.570Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::JiraImport::StuckJiraImportJobsWorker JID-c38a5a4e80b3f154235ce410: done: 0.044478 sec","job_status":"done","queue_duration_s":1.403874,"scheduling_latency_s":1.403891,"redis_calls":10,"redis_duration_s":0.002455,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000292,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001508,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000655,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025371,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00071278,"duration_s":0.044478,"completed_at":"2026-09-06T15:24:06.019Z","load_balancing_strategy":"primary","db_duration_s":0.006058,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1252gitlab # [ 230.423920] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.023Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"ac6469f768be078c5da3481d","created_at":"2026-09-06T15:24:04.580Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"f19ca76689283a1765eaffa080b179c3","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.597Z","job_size_bytes":3,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-ac6469f768be078c5da3481d: start","job_status":"start","queue_duration_s":1.425511,"scheduling_latency_s":1.425551}1253gitlab # [ 230.438058] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.067Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"ac6469f768be078c5da3481d","created_at":"2026-09-06T15:24:04.580Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"f19ca76689283a1765eaffa080b179c3","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.597Z","job_size_bytes":3,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-ac6469f768be078c5da3481d: done: 0.044709 sec","job_status":"done","queue_duration_s":1.425511,"scheduling_latency_s":1.425551,"redis_calls":10,"redis_duration_s":0.003021,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000578,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001834,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000609,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026308,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00055252,"duration_s":0.044709,"completed_at":"2026-09-06T15:24:06.067Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000686,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1254gitlab # [ 230.479669] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.071Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"01a468a27715dac7ea1e0a44","created_at":"2026-09-06T15:24:04.611Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b2b3474c1b7e91cb239b58bf26484c93","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.620Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-01a468a27715dac7ea1e0a44: start","job_status":"start","queue_duration_s":1.450828,"scheduling_latency_s":1.450868}1255gitlab # [ 230.494385] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.119Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"01a468a27715dac7ea1e0a44","created_at":"2026-09-06T15:24:04.611Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b2b3474c1b7e91cb239b58bf26484c93","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.620Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-01a468a27715dac7ea1e0a44: done: 0.048049 sec","job_status":"done","queue_duration_s":1.450828,"scheduling_latency_s":1.450868,"redis_calls":10,"redis_duration_s":0.002334,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00046,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001396,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000478,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028736,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004858,"duration_s":0.048049,"completed_at":"2026-09-06T15:24:06.119Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005748,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1256gitlab # [ 230.536682] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.121Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"71560d596ce1a70daad11482","created_at":"2026-09-06T15:24:04.627Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.636Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-71560d596ce1a70daad11482: start","job_status":"start","queue_duration_s":1.485192,"scheduling_latency_s":1.485217}1257gitlab # [ 230.550299] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.256Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"71560d596ce1a70daad11482","created_at":"2026-09-06T15:24:04.627Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.636Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-71560d596ce1a70daad11482: done: 0.134742 sec","job_status":"done","queue_duration_s":1.485192,"scheduling_latency_s":1.485217,"redis_calls":71,"redis_duration_s":0.012171000000000001,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002091,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000729,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.008774,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000577,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.118635,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026476,"duration_s":0.134742,"completed_at":"2026-09-06T15:24:06.256Z","load_balancing_strategy":"primary","db_duration_s":0.003411,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1258gitlab # [ 230.593977] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.257Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"488633c0a0c61a7057c943ff","created_at":"2026-09-06T15:24:04.668Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"331d75bbd6ca8e49d58b86b0b34f1db0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-06T15:24:04.713Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-488633c0a0c61a7057c943ff: start","job_status":"start","queue_duration_s":1.543879,"scheduling_latency_s":1.543895}1259gitlab # [ 230.607019] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.291Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"488633c0a0c61a7057c943ff","created_at":"2026-09-06T15:24:04.668Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"331d75bbd6ca8e49d58b86b0b34f1db0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-06T15:24:04.713Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-488633c0a0c61a7057c943ff: done: 0.03429 sec","job_status":"done","queue_duration_s":1.543879,"scheduling_latency_s":1.543895,"redis_calls":10,"redis_duration_s":0.0013109999999999999,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000265,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000766,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00028,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022838,"duration_s":0.03429,"completed_at":"2026-09-06T15:24:06.291Z","load_balancing_strategy":"primary","db_duration_s":0.006875,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1260gitlab # [ 230.648657] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.292Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"b6ea002c2143539d61c28d66","created_at":"2026-09-06T15:24:04.734Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d4aafca34696bfb02ba5cb1974c9e3cd","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.747Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-b6ea002c2143539d61c28d66: start","job_status":"start","queue_duration_s":1.54587,"scheduling_latency_s":1.545885}1261gitlab # [ 230.661964] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.313Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"b6ea002c2143539d61c28d66","created_at":"2026-09-06T15:24:04.734Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d4aafca34696bfb02ba5cb1974c9e3cd","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.747Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-b6ea002c2143539d61c28d66: done: 0.0204 sec","job_status":"done","queue_duration_s":1.54587,"scheduling_latency_s":1.545885,"redis_calls":12,"redis_duration_s":0.001698,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000415,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000278,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000719,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000286,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012342,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022798,"duration_s":0.0204,"completed_at":"2026-09-06T15:24:06.313Z","load_balancing_strategy":"primary","db_duration_s":0.000732,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1262gitlab # [ 230.704641] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.314Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"1e8d68dbe853b684c9802a74","created_at":"2026-09-06T15:24:04.761Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7bd96caf3f59a969ecbbabe70b3bea8e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-06T15:24:04.771Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-1e8d68dbe853b684c9802a74: start","job_status":"start","queue_duration_s":1.543143,"scheduling_latency_s":1.543159}1263gitlab # [ 230.717984] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.327Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1264gitlab # [ 230.721367] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.334Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"1e8d68dbe853b684c9802a74","created_at":"2026-09-06T15:24:04.761Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7bd96caf3f59a969ecbbabe70b3bea8e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-06T15:24:04.771Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-1e8d68dbe853b684c9802a74: done: 0.020276 sec","job_status":"done","queue_duration_s":1.543143,"scheduling_latency_s":1.543159,"redis_calls":10,"redis_duration_s":0.001476,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000341,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000849,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000286,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012785,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002352,"duration_s":0.020276,"completed_at":"2026-09-06T15:24:06.334Z","load_balancing_strategy":"primary","db_duration_s":0.000626,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1265gitlab # [ 230.762647] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.335Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["[FILTERED]"],"class":"Database::BackgroundOperation::CronEnqueueWorker","jid":"0ab5a4b18b860d65f6d28246","created_at":"2026-09-06T15:24:04.780Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec485ec4a483293a5e656c06fc070beb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5dfc48484ff3623d3ff52edf287e601d22e2b83c1335126c2dbc7ea70ce18136","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.788Z","job_size_bytes":92,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CronEnqueueWorker JID-0ab5a4b18b860d65f6d28246: start","job_status":"start","queue_duration_s":1.547196,"scheduling_latency_s":1.547213}1266gitlab # [ 230.778573] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.539Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["[FILTERED]"],"class":"Database::BackgroundOperation::CronEnqueueWorker","jid":"0ab5a4b18b860d65f6d28246","created_at":"2026-09-06T15:24:04.780Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec485ec4a483293a5e656c06fc070beb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5dfc48484ff3623d3ff52edf287e601d22e2b83c1335126c2dbc7ea70ce18136","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.788Z","job_size_bytes":92,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CronEnqueueWorker JID-0ab5a4b18b860d65f6d28246: done: 0.203548 sec","job_status":"done","queue_duration_s":1.547196,"scheduling_latency_s":1.547213,"redis_calls":10,"redis_duration_s":0.001413,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000288,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00084,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000285,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.172946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023788,"duration_s":0.203548,"completed_at":"2026-09-06T15:24:06.539Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024451,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1267gitlab # [ 230.821005] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.540Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"32b35df06005e80093280c86","created_at":"2026-09-06T15:24:04.831Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9e798f467d577c13f586b0d5b2fbbf28","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.848Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-32b35df06005e80093280c86: start","job_status":"start","queue_duration_s":1.691952,"scheduling_latency_s":1.691968}1268gitlab # [ 230.835270] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.560Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"32b35df06005e80093280c86","created_at":"2026-09-06T15:24:04.831Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9e798f467d577c13f586b0d5b2fbbf28","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.848Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-32b35df06005e80093280c86: done: 0.019968 sec","job_status":"done","queue_duration_s":1.691952,"scheduling_latency_s":1.691968,"redis_calls":12,"redis_duration_s":0.001702,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000294,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000739,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000669,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011264,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002342,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.019968,"completed_at":"2026-09-06T15:24:06.560Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000811,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1269gitlab # [ 230.880529] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.561Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"2b5428fd0ec405384ec5b7b0","created_at":"2026-09-06T15:24:04.854Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8c65c241c41363e1e3ec188c9e16cb0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.870Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-2b5428fd0ec405384ec5b7b0: start","job_status":"start","queue_duration_s":1.691726,"scheduling_latency_s":1.691741}1270gitlab # [ 230.980216] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.832Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"2b5428fd0ec405384ec5b7b0","created_at":"2026-09-06T15:24:04.854Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8c65c241c41363e1e3ec188c9e16cb0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.870Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-2b5428fd0ec405384ec5b7b0: done: 0.270989 sec","job_status":"done","queue_duration_s":1.691726,"scheduling_latency_s":1.691741,"redis_calls":14,"redis_duration_s":0.002203,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000574,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000864,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000765,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.059,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.059,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.190059,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00046854,"exclusive_lock_hold_duration_s":0.2487797,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.270989,"completed_at":"2026-09-06T15:24:06.832Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.091069,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1271gitlab # [ 231.068817] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.834Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"117f4bd7bd901e3df601831d","created_at":"2026-09-06T15:24:04.898Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1bb1d17b0bb1c2fce773f4782cbfaee","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.922Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-117f4bd7bd901e3df601831d: start","job_status":"start","queue_duration_s":1.911911,"scheduling_latency_s":1.91194}1272gitlab # [ 231.086318] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.850Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1273gitlab # [ 231.090112] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.861Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"117f4bd7bd901e3df601831d","created_at":"2026-09-06T15:24:04.898Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1bb1d17b0bb1c2fce773f4782cbfaee","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.922Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-117f4bd7bd901e3df601831d: done: 0.027619 sec","job_status":"done","queue_duration_s":1.911911,"scheduling_latency_s":1.91194,"redis_calls":10,"redis_duration_s":0.0024360000000000002,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00055,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001407,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000479,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00042758,"duration_s":0.027619,"completed_at":"2026-09-06T15:24:06.861Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002425,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1274gitlab # [ 231.133540] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.863Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"bd377f693dd3657aee3ee6b8","created_at":"2026-09-06T15:24:04.968Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd1dcac93a9b3060c2ca34efa53d2f42","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.999Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-bd377f693dd3657aee3ee6b8: start","job_status":"start","queue_duration_s":1.863616,"scheduling_latency_s":1.863632}1275gitlab # [ 231.148251] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.896Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"bd377f693dd3657aee3ee6b8","created_at":"2026-09-06T15:24:04.968Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd1dcac93a9b3060c2ca34efa53d2f42","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:04.999Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-bd377f693dd3657aee3ee6b8: done: 0.033152 sec","job_status":"done","queue_duration_s":1.863616,"scheduling_latency_s":1.863632,"redis_calls":13,"redis_duration_s":0.003131,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000575,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001515,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001041,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01144416,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.033152,"completed_at":"2026-09-06T15:24:06.896Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004453,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1276gitlab # [ 231.194028] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.897Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"7ca95b8484e308e3481b41dc","created_at":"2026-09-06T15:24:05.038Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8e2ab61aacd067254cd7a82069b4252e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:05.056Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-7ca95b8484e308e3481b41dc: start","job_status":"start","queue_duration_s":1.841613,"scheduling_latency_s":1.841628}1277gitlab # [ 231.208744] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.920Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"7ca95b8484e308e3481b41dc","created_at":"2026-09-06T15:24:05.038Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8e2ab61aacd067254cd7a82069b4252e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:05.056Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-7ca95b8484e308e3481b41dc: done: 0.023056 sec","job_status":"done","queue_duration_s":1.841613,"scheduling_latency_s":1.841628,"redis_calls":12,"redis_duration_s":0.002895,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001094,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001341,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00046,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013549,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003288,"duration_s":0.023056,"completed_at":"2026-09-06T15:24:06.920Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001459,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1278gitlab # [ 231.251853] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.922Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"4256195e9e45451a2c152cd1","created_at":"2026-09-06T15:24:05.092Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"900218a7d41c47d100cf7d595614e9f4","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:05.123Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-4256195e9e45451a2c152cd1: start","job_status":"start","queue_duration_s":1.798832,"scheduling_latency_s":1.798847}1279gitlab # [ 231.266022] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.975Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"4256195e9e45451a2c152cd1","created_at":"2026-09-06T15:24:05.092Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"900218a7d41c47d100cf7d595614e9f4","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:05.123Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-4256195e9e45451a2c152cd1: done: 0.053609 sec","job_status":"done","queue_duration_s":1.798832,"scheduling_latency_s":1.798847,"redis_calls":10,"redis_duration_s":0.003031,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000488,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001973,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00057,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015016,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004469,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.053609,"completed_at":"2026-09-06T15:24:06.975Z","load_balancing_strategy":"primary","db_duration_s":0.024361,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1280gitlab # [ 231.309027] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:06.977Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"c3c0c8ae16993d8863406e98","created_at":"2026-09-06T15:24:05.142Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"290f3e6bbc9351ca3c01a0bdfb32c6be","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:05.292Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-c3c0c8ae16993d8863406e98: start","job_status":"start","queue_duration_s":1.684907,"scheduling_latency_s":1.684928}1281gitlab # [ 231.323503] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.006Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"c3c0c8ae16993d8863406e98","created_at":"2026-09-06T15:24:05.142Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"290f3e6bbc9351ca3c01a0bdfb32c6be","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:05.292Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-c3c0c8ae16993d8863406e98: done: 0.028551 sec","job_status":"done","queue_duration_s":1.684907,"scheduling_latency_s":1.684928,"redis_calls":12,"redis_duration_s":0.003294,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000586,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001477,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001231,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0006265,"exclusive_lock_hold_duration_s":0.00408756,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.028551,"completed_at":"2026-09-06T15:24:07.006Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00305,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1282gitlab # [ 231.367236] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.008Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"5c3459a7aca7cc9603ca1409","created_at":"2026-09-06T15:24:05.318Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9ff1541cd2cd8f936233fb1d98c2273a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:05.343Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-5c3459a7aca7cc9603ca1409: start","job_status":"start","queue_duration_s":1.664795,"scheduling_latency_s":1.664812}1283gitlab # [ 231.382011] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.031Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"5c3459a7aca7cc9603ca1409","created_at":"2026-09-06T15:24:05.318Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9ff1541cd2cd8f936233fb1d98c2273a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-06T15:24:05.343Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-5c3459a7aca7cc9603ca1409: done: 0.023786 sec","job_status":"done","queue_duration_s":1.664795,"scheduling_latency_s":1.664812,"redis_calls":10,"redis_duration_s":0.002556,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000611,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001446,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000499,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013254,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036324,"duration_s":0.023786,"completed_at":"2026-09-06T15:24:07.031Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000726,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1284gitlab # [ 231.425832] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.033Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4588aa060bb2d3c750e487df","created_at":"2026-09-06T15:24:05.882Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-3792c6a7461e44ac","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9b1e5462a850210c1755de25fe432303","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:05.896Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4588aa060bb2d3c750e487df: start","job_status":"start","queue_duration_s":1.136799,"scheduling_latency_s":1.136816}1285gitlab # [ 231.438195] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.051Z","message":"No existing merge request to be cleaned up."}1286gitlab # [ 231.439819] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.066Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4588aa060bb2d3c750e487df","created_at":"2026-09-06T15:24:05.882Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-3792c6a7461e44ac","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9b1e5462a850210c1755de25fe432303","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:05.896Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4588aa060bb2d3c750e487df: done: 0.032715 sec","job_status":"done","queue_duration_s":1.136799,"scheduling_latency_s":1.136816,"redis_calls":13,"redis_duration_s":0.003506,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000545,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001214,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001747,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003324,"duration_s":0.032715,"completed_at":"2026-09-06T15:24:07.066Z","load_balancing_strategy":"primary","db_duration_s":0.005608,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1287gitlab # [ 231.479823] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.067Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8f5d6b114eeae5f24185e27a","created_at":"2026-09-06T15:24:05.882Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-3792c6a7461e44ac","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9b1e5462a850210c1755de25fe432303","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:05.896Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8f5d6b114eeae5f24185e27a: start","job_status":"start","queue_duration_s":1.170921,"scheduling_latency_s":1.170936}1288gitlab # [ 231.492319] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.079Z","message":"No existing merge request to be cleaned up."}1289gitlab # [ 231.493975] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.088Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8f5d6b114eeae5f24185e27a","created_at":"2026-09-06T15:24:05.882Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-3792c6a7461e44ac","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9b1e5462a850210c1755de25fe432303","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:05.896Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8f5d6b114eeae5f24185e27a: done: 0.020578 sec","job_status":"done","queue_duration_s":1.170921,"scheduling_latency_s":1.170936,"redis_calls":10,"redis_duration_s":0.002428,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000999,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001429,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013526,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020578,"completed_at":"2026-09-06T15:24:07.088Z","load_balancing_strategy":"primary","db_duration_s":0.002545,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1290gitlab # [ 231.532239] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.090Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7db314598cb6e52f0476589a","created_at":"2026-09-06T15:24:05.882Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-3792c6a7461e44ac","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9b1e5462a850210c1755de25fe432303","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:05.896Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7db314598cb6e52f0476589a: start","job_status":"start","queue_duration_s":1.193614,"scheduling_latency_s":1.19363}1291gitlab # [ 231.544134] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.101Z","message":"No existing merge request to be cleaned up."}1292gitlab # [ 231.545765] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.110Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7db314598cb6e52f0476589a","created_at":"2026-09-06T15:24:05.882Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-3792c6a7461e44ac","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9b1e5462a850210c1755de25fe432303","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:05.896Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7db314598cb6e52f0476589a: done: 0.020478 sec","job_status":"done","queue_duration_s":1.193614,"scheduling_latency_s":1.19363,"redis_calls":10,"redis_duration_s":0.002509,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00146,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013418,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020478,"completed_at":"2026-09-06T15:24:07.110Z","load_balancing_strategy":"primary","db_duration_s":0.00246,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1293gitlab # [ 231.583831] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.112Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e55171f4bd81323215aa3b96","created_at":"2026-09-06T15:24:05.882Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-3792c6a7461e44ac","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9b1e5462a850210c1755de25fe432303","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:05.896Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e55171f4bd81323215aa3b96: start","job_status":"start","queue_duration_s":1.215434,"scheduling_latency_s":1.215448}1294gitlab # [ 231.597393] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.123Z","message":"No existing merge request to be cleaned up."}1295gitlab # [ 231.599030] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.132Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e55171f4bd81323215aa3b96","created_at":"2026-09-06T15:24:05.882Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-3792c6a7461e44ac","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9b1e5462a850210c1755de25fe432303","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:05.896Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e55171f4bd81323215aa3b96: done: 0.019921 sec","job_status":"done","queue_duration_s":1.215434,"scheduling_latency_s":1.215448,"redis_calls":10,"redis_duration_s":0.002449,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.0014,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019921,"completed_at":"2026-09-06T15:24:07.132Z","load_balancing_strategy":"primary","db_duration_s":0.002409,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1296gitlab # [ 231.637121] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.133Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b6c680968ed2489eadb8cb5","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b6c680968ed2489eadb8cb5: start","job_status":"start","queue_duration_s":0.887071,"scheduling_latency_s":0.887085}1297gitlab # [ 231.649400] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b6c680968ed2489eadb8cb5","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b6c680968ed2489eadb8cb5: done: 0.023277 sec","job_status":"done","queue_duration_s":0.887071,"scheduling_latency_s":0.887085,"redis_calls":16,"redis_duration_s":0.003849,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0006,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001074,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002175,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013686,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032246,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023277,"completed_at":"2026-09-06T15:24:07.156Z","load_balancing_strategy":"primary","db_duration_s":0.000872,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1298gitlab # [ 231.690398] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.158Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2504f8b0e33bf507d82a7556","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2504f8b0e33bf507d82a7556: start","job_status":"start","queue_duration_s":0.911636,"scheduling_latency_s":0.911659}1299gitlab # [ 231.702978] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.175Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2504f8b0e33bf507d82a7556","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2504f8b0e33bf507d82a7556: done: 0.017464 sec","job_status":"done","queue_duration_s":0.911636,"scheduling_latency_s":0.911659,"redis_calls":13,"redis_duration_s":0.003283,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001387,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001896,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010539,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017464,"completed_at":"2026-09-06T15:24:07.175Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 231.743450] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.177Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32cce8f8e8aa4d9d76cb3057","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32cce8f8e8aa4d9d76cb3057: start","job_status":"start","queue_duration_s":0.930524,"scheduling_latency_s":0.930539}1301gitlab # [ 231.755908] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.193Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32cce8f8e8aa4d9d76cb3057","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32cce8f8e8aa4d9d76cb3057: done: 0.01614 sec","job_status":"done","queue_duration_s":0.930524,"scheduling_latency_s":0.930539,"redis_calls":13,"redis_duration_s":0.002984,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01614,"completed_at":"2026-09-06T15:24:07.193Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 231.795082] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.194Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf4287039e697d613a6c6fdc","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf4287039e697d613a6c6fdc: start","job_status":"start","queue_duration_s":0.948039,"scheduling_latency_s":0.948053}1303gitlab # [ 231.808646] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.210Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf4287039e697d613a6c6fdc","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf4287039e697d613a6c6fdc: done: 0.015419 sec","job_status":"done","queue_duration_s":0.948039,"scheduling_latency_s":0.948053,"redis_calls":13,"redis_duration_s":0.002768,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001865,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015419,"completed_at":"2026-09-06T15:24:07.209Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 231.847719] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7adcd6af0cff7676968030e3","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7adcd6af0cff7676968030e3: start","job_status":"start","queue_duration_s":0.964804,"scheduling_latency_s":0.964818}1305gitlab # [ 231.864376] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7adcd6af0cff7676968030e3","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7adcd6af0cff7676968030e3: done: 0.015356 sec","job_status":"done","queue_duration_s":0.964804,"scheduling_latency_s":0.964818,"redis_calls":13,"redis_duration_s":0.002653,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000888,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001765,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015356,"completed_at":"2026-09-06T15:24:07.226Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 231.903041] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.228Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f363e7e5f8c41092394075d","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f363e7e5f8c41092394075d: start","job_status":"start","queue_duration_s":0.981495,"scheduling_latency_s":0.981509}1307gitlab # [ 231.915403] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.243Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f363e7e5f8c41092394075d","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f363e7e5f8c41092394075d: done: 0.01509 sec","job_status":"done","queue_duration_s":0.981495,"scheduling_latency_s":0.981509,"redis_calls":13,"redis_duration_s":0.0025250000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000889,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001636,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01509,"completed_at":"2026-09-06T15:24:07.243Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 231.953950] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.244Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"015a602aee334afe9ad301cf","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-015a602aee334afe9ad301cf: start","job_status":"start","queue_duration_s":0.997953,"scheduling_latency_s":0.997967}1309gitlab # [ 231.966104] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.259Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"015a602aee334afe9ad301cf","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-015a602aee334afe9ad301cf: done: 0.01543 sec","job_status":"done","queue_duration_s":0.997953,"scheduling_latency_s":0.997967,"redis_calls":13,"redis_duration_s":0.002781,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000958,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001823,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009882,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01543,"completed_at":"2026-09-06T15:24:07.259Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 232.006308] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.261Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"448bd74e8542c5fba8415f66","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-448bd74e8542c5fba8415f66: start","job_status":"start","queue_duration_s":1.014732,"scheduling_latency_s":1.014747}1311gitlab # [ 232.019046] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.276Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"448bd74e8542c5fba8415f66","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-448bd74e8542c5fba8415f66: done: 0.014797 sec","job_status":"done","queue_duration_s":1.014732,"scheduling_latency_s":1.014747,"redis_calls":13,"redis_duration_s":0.0025729999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000904,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001669,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014797,"completed_at":"2026-09-06T15:24:07.276Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 232.059008] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.277Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0829d6aec315475ff1d97e44","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0829d6aec315475ff1d97e44: start","job_status":"start","queue_duration_s":1.031018,"scheduling_latency_s":1.031032}1313gitlab # [ 232.071502] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.292Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0829d6aec315475ff1d97e44","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0829d6aec315475ff1d97e44: done: 0.014758 sec","job_status":"done","queue_duration_s":1.031018,"scheduling_latency_s":1.031032,"redis_calls":13,"redis_duration_s":0.002486,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000905,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001581,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009458,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014758,"completed_at":"2026-09-06T15:24:07.292Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 232.110992] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.293Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce27b886fb696b6ac10ed73c","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce27b886fb696b6ac10ed73c: start","job_status":"start","queue_duration_s":1.047218,"scheduling_latency_s":1.047234}1315gitlab # [ 232.123368] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.308Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce27b886fb696b6ac10ed73c","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce27b886fb696b6ac10ed73c: done: 0.014961 sec","job_status":"done","queue_duration_s":1.047218,"scheduling_latency_s":1.047234,"redis_calls":13,"redis_duration_s":0.00274,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000893,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001847,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014961,"completed_at":"2026-09-06T15:24:07.308Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 232.162405] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.310Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51d24c7e123d136ca3b7eb14","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51d24c7e123d136ca3b7eb14: start","job_status":"start","queue_duration_s":1.063441,"scheduling_latency_s":1.063455}1317gitlab # [ 232.174848] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51d24c7e123d136ca3b7eb14","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51d24c7e123d136ca3b7eb14: done: 0.015243 sec","job_status":"done","queue_duration_s":1.063441,"scheduling_latency_s":1.063455,"redis_calls":13,"redis_duration_s":0.002803,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001896,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009554,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015243,"completed_at":"2026-09-06T15:24:07.325Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 232.215000] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.326Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23664add7039bc8c6595a305","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23664add7039bc8c6595a305: start","job_status":"start","queue_duration_s":1.080027,"scheduling_latency_s":1.080041}1319gitlab # [ 232.227549] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.341Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23664add7039bc8c6595a305","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23664add7039bc8c6595a305: done: 0.014694 sec","job_status":"done","queue_duration_s":1.080027,"scheduling_latency_s":1.080041,"redis_calls":13,"redis_duration_s":0.002432,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001548,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009205,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014694,"completed_at":"2026-09-06T15:24:07.341Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 232.266652] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.342Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1fab23f614ddd0a8c6b308f9","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1fab23f614ddd0a8c6b308f9: start","job_status":"start","queue_duration_s":1.096364,"scheduling_latency_s":1.096378}1321gitlab # [ 232.279191] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.358Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1fab23f614ddd0a8c6b308f9","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1fab23f614ddd0a8c6b308f9: done: 0.015204 sec","job_status":"done","queue_duration_s":1.096364,"scheduling_latency_s":1.096378,"redis_calls":13,"redis_duration_s":0.002711,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000901,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00181,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015204,"completed_at":"2026-09-06T15:24:07.358Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322gitlab # [ 232.318183] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.359Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5bac0353419daf23ed62d22b","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5bac0353419daf23ed62d22b: start","job_status":"start","queue_duration_s":1.112964,"scheduling_latency_s":1.112978}1323gitlab # [ 232.330617] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.374Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5bac0353419daf23ed62d22b","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5bac0353419daf23ed62d22b: done: 0.015406 sec","job_status":"done","queue_duration_s":1.112964,"scheduling_latency_s":1.112978,"redis_calls":13,"redis_duration_s":0.002806,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000958,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001848,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009774,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015406,"completed_at":"2026-09-06T15:24:07.374Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 232.369659] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83238573bb7f25413ca95af0","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83238573bb7f25413ca95af0: start","job_status":"start","queue_duration_s":1.129781,"scheduling_latency_s":1.129795}1325gitlab # [ 232.382114] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.391Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83238573bb7f25413ca95af0","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83238573bb7f25413ca95af0: done: 0.015259 sec","job_status":"done","queue_duration_s":1.129781,"scheduling_latency_s":1.129795,"redis_calls":13,"redis_duration_s":0.002716,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00087,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001846,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009651,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015259,"completed_at":"2026-09-06T15:24:07.391Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 232.421281] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.392Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c54aac75c8e22eac7e2aba3","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c54aac75c8e22eac7e2aba3: start","job_status":"start","queue_duration_s":1.146399,"scheduling_latency_s":1.146413}1327gitlab # [ 232.433446] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c54aac75c8e22eac7e2aba3","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c54aac75c8e22eac7e2aba3: done: 0.015152 sec","job_status":"done","queue_duration_s":1.146399,"scheduling_latency_s":1.146413,"redis_calls":13,"redis_duration_s":0.0024850000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001585,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009285,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015152,"completed_at":"2026-09-06T15:24:07.408Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 232.471624] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9cf2ee80d76ecbaa11ef805","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9cf2ee80d76ecbaa11ef805: start","job_status":"start","queue_duration_s":1.16284,"scheduling_latency_s":1.162854}1329gitlab # [ 232.483891] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.424Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9cf2ee80d76ecbaa11ef805","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9cf2ee80d76ecbaa11ef805: done: 0.014848 sec","job_status":"done","queue_duration_s":1.16284,"scheduling_latency_s":1.162854,"redis_calls":13,"redis_duration_s":0.0024790000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000889,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00159,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014848,"completed_at":"2026-09-06T15:24:07.424Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 232.522120] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9504c1cf203a80364e559846","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9504c1cf203a80364e559846: start","job_status":"start","queue_duration_s":1.179042,"scheduling_latency_s":1.179056}1331gitlab # [ 232.534241] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9504c1cf203a80364e559846","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9504c1cf203a80364e559846: done: 0.01498 sec","job_status":"done","queue_duration_s":1.179042,"scheduling_latency_s":1.179056,"redis_calls":13,"redis_duration_s":0.002643,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000913,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00173,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01498,"completed_at":"2026-09-06T15:24:07.440Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 232.572543] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a055b2dab3470217126e551","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a055b2dab3470217126e551: start","job_status":"start","queue_duration_s":1.195283,"scheduling_latency_s":1.195297}1333gitlab # [ 232.585256] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.457Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a055b2dab3470217126e551","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a055b2dab3470217126e551: done: 0.015477 sec","job_status":"done","queue_duration_s":1.195283,"scheduling_latency_s":1.195297,"redis_calls":13,"redis_duration_s":0.002772,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001855,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009808,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015477,"completed_at":"2026-09-06T15:24:07.457Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 232.625709] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"399a0263cba73686c3cd84e1","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-399a0263cba73686c3cd84e1: start","job_status":"start","queue_duration_s":1.212094,"scheduling_latency_s":1.212109}1335gitlab # [ 232.638176] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.474Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"399a0263cba73686c3cd84e1","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-399a0263cba73686c3cd84e1: done: 0.015891 sec","job_status":"done","queue_duration_s":1.212094,"scheduling_latency_s":1.212109,"redis_calls":13,"redis_duration_s":0.003065,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000892,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002173,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015891,"completed_at":"2026-09-06T15:24:07.474Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 232.677292] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.475Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1966729d91099cb22d728b99","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1966729d91099cb22d728b99: start","job_status":"start","queue_duration_s":1.22935,"scheduling_latency_s":1.229364}1337gitlab # [ 232.689678] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.491Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1966729d91099cb22d728b99","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1966729d91099cb22d728b99: done: 0.01566 sec","job_status":"done","queue_duration_s":1.22935,"scheduling_latency_s":1.229364,"redis_calls":13,"redis_duration_s":0.002761,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000895,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001866,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01566,"completed_at":"2026-09-06T15:24:07.491Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338gitlab # [ 232.728733] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.492Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"271496ba50902d5b1b653ac7","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-271496ba50902d5b1b653ac7: start","job_status":"start","queue_duration_s":1.246313,"scheduling_latency_s":1.246327}1339gitlab # [ 232.741067] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.509Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"271496ba50902d5b1b653ac7","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-271496ba50902d5b1b653ac7: done: 0.016166 sec","job_status":"done","queue_duration_s":1.246313,"scheduling_latency_s":1.246327,"redis_calls":13,"redis_duration_s":0.002581,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001666,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016166,"completed_at":"2026-09-06T15:24:07.508Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 232.780269] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.510Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e29fbdbd6eb29e0f62f20117","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e29fbdbd6eb29e0f62f20117: start","job_status":"start","queue_duration_s":1.263764,"scheduling_latency_s":1.263779}1341gitlab # [ 232.792481] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.526Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e29fbdbd6eb29e0f62f20117","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e29fbdbd6eb29e0f62f20117: done: 0.016503 sec","job_status":"done","queue_duration_s":1.263764,"scheduling_latency_s":1.263779,"redis_calls":13,"redis_duration_s":0.002987,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000971,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016503,"completed_at":"2026-09-06T15:24:07.526Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 232.832760] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c07d3e1204af697aad4686b2","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c07d3e1204af697aad4686b2: start","job_status":"start","queue_duration_s":1.281622,"scheduling_latency_s":1.281637}1343gitlab # [ 232.845100] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c07d3e1204af697aad4686b2","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c07d3e1204af697aad4686b2: done: 0.016142 sec","job_status":"done","queue_duration_s":1.281622,"scheduling_latency_s":1.281637,"redis_calls":13,"redis_duration_s":0.002604,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001652,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016142,"completed_at":"2026-09-06T15:24:07.544Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 232.884174] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.546Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbeda13d0105521adb4dc104","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbeda13d0105521adb4dc104: start","job_status":"start","queue_duration_s":1.299473,"scheduling_latency_s":1.299488}1345gitlab # [ 232.896436] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.561Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbeda13d0105521adb4dc104","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbeda13d0105521adb4dc104: done: 0.01595 sec","job_status":"done","queue_duration_s":1.299473,"scheduling_latency_s":1.299488,"redis_calls":13,"redis_duration_s":0.002719,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001802,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01003,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01595,"completed_at":"2026-09-06T15:24:07.561Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 232.935821] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.563Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc01a995566f4b886d9b8bfe","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc01a995566f4b886d9b8bfe: start","job_status":"start","queue_duration_s":1.317205,"scheduling_latency_s":1.317221}1347gitlab # [ 232.948562] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.580Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc01a995566f4b886d9b8bfe","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc01a995566f4b886d9b8bfe: done: 0.01659 sec","job_status":"done","queue_duration_s":1.317205,"scheduling_latency_s":1.317221,"redis_calls":13,"redis_duration_s":0.002823,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000963,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00186,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01659,"completed_at":"2026-09-06T15:24:07.580Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 232.987599] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.582Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce6f59ec4335890679b08f92","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce6f59ec4335890679b08f92: start","job_status":"start","queue_duration_s":1.335602,"scheduling_latency_s":1.335618}1349gitlab # [ 233.000596] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.598Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce6f59ec4335890679b08f92","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce6f59ec4335890679b08f92: done: 0.016694 sec","job_status":"done","queue_duration_s":1.335602,"scheduling_latency_s":1.335618,"redis_calls":13,"redis_duration_s":0.0027619999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000918,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001844,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016694,"completed_at":"2026-09-06T15:24:07.598Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 233.040882] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.600Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"954e418027bc39da107e11d8","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-954e418027bc39da107e11d8: start","job_status":"start","queue_duration_s":1.354129,"scheduling_latency_s":1.354145}1351gitlab # [ 233.053619] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.616Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"954e418027bc39da107e11d8","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-954e418027bc39da107e11d8: done: 0.016264 sec","job_status":"done","queue_duration_s":1.354129,"scheduling_latency_s":1.354145,"redis_calls":13,"redis_duration_s":0.002666,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001751,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010739,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016264,"completed_at":"2026-09-06T15:24:07.616Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 233.093520] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.618Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81f2e6c0bf74551a679d59ee","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81f2e6c0bf74551a679d59ee: start","job_status":"start","queue_duration_s":1.372171,"scheduling_latency_s":1.372188}1353gitlab # [ 233.105930] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81f2e6c0bf74551a679d59ee","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81f2e6c0bf74551a679d59ee: done: 0.017011 sec","job_status":"done","queue_duration_s":1.372171,"scheduling_latency_s":1.372188,"redis_calls":13,"redis_duration_s":0.002631,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001729,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010939,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017011,"completed_at":"2026-09-06T15:24:07.635Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 233.145354] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.636Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1999639287b6f4e1eb2da8a3","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1999639287b6f4e1eb2da8a3: start","job_status":"start","queue_duration_s":1.390145,"scheduling_latency_s":1.390159}1355gitlab # [ 233.157690] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.653Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1999639287b6f4e1eb2da8a3","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1999639287b6f4e1eb2da8a3: done: 0.016921 sec","job_status":"done","queue_duration_s":1.390145,"scheduling_latency_s":1.390159,"redis_calls":13,"redis_duration_s":0.002756,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000875,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001881,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016921,"completed_at":"2026-09-06T15:24:07.653Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 233.196446] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.655Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f835090026f2c381f1fdb7c","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f835090026f2c381f1fdb7c: start","job_status":"start","queue_duration_s":1.408557,"scheduling_latency_s":1.408572}1357gitlab # [ 233.208647] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.672Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f835090026f2c381f1fdb7c","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f835090026f2c381f1fdb7c: done: 0.017295 sec","job_status":"done","queue_duration_s":1.408557,"scheduling_latency_s":1.408572,"redis_calls":13,"redis_duration_s":0.003493,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000971,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002522,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010403,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017295,"completed_at":"2026-09-06T15:24:07.672Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 233.248649] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.673Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"454b6cc7516f3296c76051e2","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-454b6cc7516f3296c76051e2: start","job_status":"start","queue_duration_s":1.427126,"scheduling_latency_s":1.427141}1359gitlab # [ 233.260844] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.690Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"454b6cc7516f3296c76051e2","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-454b6cc7516f3296c76051e2: done: 0.016641 sec","job_status":"done","queue_duration_s":1.427126,"scheduling_latency_s":1.427141,"redis_calls":13,"redis_duration_s":0.002725,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001823,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010292,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016641,"completed_at":"2026-09-06T15:24:07.690Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 233.299784] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.691Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aebe372887d3a4362daeed65","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aebe372887d3a4362daeed65: start","job_status":"start","queue_duration_s":1.445086,"scheduling_latency_s":1.445101}1361gitlab # [ 233.312272] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.708Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aebe372887d3a4362daeed65","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aebe372887d3a4362daeed65: done: 0.016951 sec","job_status":"done","queue_duration_s":1.445086,"scheduling_latency_s":1.445101,"redis_calls":13,"redis_duration_s":0.002809,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000945,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001864,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010498,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016951,"completed_at":"2026-09-06T15:24:07.708Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 233.350969] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.710Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf9b240fbedbebf50f83bcc4","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf9b240fbedbebf50f83bcc4: start","job_status":"start","queue_duration_s":1.463425,"scheduling_latency_s":1.463439}1363gitlab # [ 233.363349] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.726Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf9b240fbedbebf50f83bcc4","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf9b240fbedbebf50f83bcc4: done: 0.016356 sec","job_status":"done","queue_duration_s":1.463425,"scheduling_latency_s":1.463439,"redis_calls":13,"redis_duration_s":0.002634,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001731,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010349,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016356,"completed_at":"2026-09-06T15:24:07.726Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 233.402295] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.728Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7db401ffa4a30af4c185e25","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7db401ffa4a30af4c185e25: start","job_status":"start","queue_duration_s":1.481583,"scheduling_latency_s":1.481597}1365gitlab # [ 233.414765] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.744Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7db401ffa4a30af4c185e25","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7db401ffa4a30af4c185e25: done: 0.016355 sec","job_status":"done","queue_duration_s":1.481583,"scheduling_latency_s":1.481597,"redis_calls":13,"redis_duration_s":0.00285,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000944,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010299,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016355,"completed_at":"2026-09-06T15:24:07.744Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 233.454822] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.746Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7cc40d023e0e73ad37b4f21","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7cc40d023e0e73ad37b4f21: start","job_status":"start","queue_duration_s":1.499654,"scheduling_latency_s":1.499669}1367gitlab # [ 233.467354] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.762Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7cc40d023e0e73ad37b4f21","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7cc40d023e0e73ad37b4f21: done: 0.016374 sec","job_status":"done","queue_duration_s":1.499654,"scheduling_latency_s":1.499669,"redis_calls":13,"redis_duration_s":0.002735,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000901,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001834,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010792,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016374,"completed_at":"2026-09-06T15:24:07.762Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 233.506487] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.766Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a44a2dbf988a37ce0873b20","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a44a2dbf988a37ce0873b20: start","job_status":"start","queue_duration_s":1.520068,"scheduling_latency_s":1.520085}1369gitlab # [ 233.518881] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.783Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a44a2dbf988a37ce0873b20","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a44a2dbf988a37ce0873b20: done: 0.016583 sec","job_status":"done","queue_duration_s":1.520068,"scheduling_latency_s":1.520085,"redis_calls":13,"redis_duration_s":0.002841,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001899,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016583,"completed_at":"2026-09-06T15:24:07.783Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 233.556828] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.784Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ddcef8331e5b2485765f3af","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ddcef8331e5b2485765f3af: start","job_status":"start","queue_duration_s":1.538367,"scheduling_latency_s":1.538382}1371gitlab # [ 233.568817] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ddcef8331e5b2485765f3af","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ddcef8331e5b2485765f3af: done: 0.01575 sec","job_status":"done","queue_duration_s":1.538367,"scheduling_latency_s":1.538382,"redis_calls":13,"redis_duration_s":0.00249,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00158,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01575,"completed_at":"2026-09-06T15:24:07.800Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 233.606675] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.802Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a22070eec3ca58ca91f53c4b","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a22070eec3ca58ca91f53c4b: start","job_status":"start","queue_duration_s":1.555914,"scheduling_latency_s":1.55593}1373gitlab # [ 233.618936] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.818Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a22070eec3ca58ca91f53c4b","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a22070eec3ca58ca91f53c4b: done: 0.016434 sec","job_status":"done","queue_duration_s":1.555914,"scheduling_latency_s":1.55593,"redis_calls":13,"redis_duration_s":0.0015530000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001015,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011965,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016434,"completed_at":"2026-09-06T15:24:07.818Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 233.658608] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.820Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9feb977c9ff70bdf32a87555","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9feb977c9ff70bdf32a87555: start","job_status":"start","queue_duration_s":1.573477,"scheduling_latency_s":1.573492}1375gitlab # [ 233.670832] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.837Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9feb977c9ff70bdf32a87555","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9feb977c9ff70bdf32a87555: done: 0.017019 sec","job_status":"done","queue_duration_s":1.573477,"scheduling_latency_s":1.573492,"redis_calls":13,"redis_duration_s":0.001841,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001297,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017019,"completed_at":"2026-09-06T15:24:07.836Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 233.708946] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.838Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8de7125661a171336b729b7","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8de7125661a171336b729b7: start","job_status":"start","queue_duration_s":1.592037,"scheduling_latency_s":1.592053}1377gitlab # [ 233.721010] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.854Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8de7125661a171336b729b7","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8de7125661a171336b729b7: done: 0.016129 sec","job_status":"done","queue_duration_s":1.592037,"scheduling_latency_s":1.592053,"redis_calls":13,"redis_duration_s":0.001513,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000575,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016129,"completed_at":"2026-09-06T15:24:07.854Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 233.759126] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.855Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f166bc861c6417baa8002cb5","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f166bc861c6417baa8002cb5: start","job_status":"start","queue_duration_s":1.609276,"scheduling_latency_s":1.609291}1379gitlab # [ 233.771411] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.869Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f166bc861c6417baa8002cb5","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f166bc861c6417baa8002cb5: done: 0.01412 sec","job_status":"done","queue_duration_s":1.609276,"scheduling_latency_s":1.609291,"redis_calls":13,"redis_duration_s":0.0014160000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009793,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01412,"completed_at":"2026-09-06T15:24:07.869Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 233.809862] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.871Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94f8c045a275a7d2b142ec5e","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94f8c045a275a7d2b142ec5e: start","job_status":"start","queue_duration_s":1.624717,"scheduling_latency_s":1.624734}1381gitlab # [ 233.822072] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.885Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94f8c045a275a7d2b142ec5e","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94f8c045a275a7d2b142ec5e: done: 0.014012 sec","job_status":"done","queue_duration_s":1.624717,"scheduling_latency_s":1.624734,"redis_calls":13,"redis_duration_s":0.001398,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000899,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009713,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014012,"completed_at":"2026-09-06T15:24:07.885Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 233.861106] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.886Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad13c574504162eb4b186a22","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad13c574504162eb4b186a22: start","job_status":"start","queue_duration_s":1.64,"scheduling_latency_s":1.640018}1383gitlab # [ 233.873171] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.900Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad13c574504162eb4b186a22","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad13c574504162eb4b186a22: done: 0.014312 sec","job_status":"done","queue_duration_s":1.64,"scheduling_latency_s":1.640018,"redis_calls":13,"redis_duration_s":0.0014620000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014312,"completed_at":"2026-09-06T15:24:07.900Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 233.911268] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.902Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f05a08063c6c6ae0ca3fc4e","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f05a08063c6c6ae0ca3fc4e: start","job_status":"start","queue_duration_s":1.655568,"scheduling_latency_s":1.655584}1385gitlab # [ 233.923475] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f05a08063c6c6ae0ca3fc4e","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f05a08063c6c6ae0ca3fc4e: done: 0.014197 sec","job_status":"done","queue_duration_s":1.655568,"scheduling_latency_s":1.655584,"redis_calls":13,"redis_duration_s":0.001404,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00985,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014197,"completed_at":"2026-09-06T15:24:07.916Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 233.961506] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61939d3342bebc7eaf6528a8","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61939d3342bebc7eaf6528a8: start","job_status":"start","queue_duration_s":1.670862,"scheduling_latency_s":1.670877}1387gitlab # [ 233.973870] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.931Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61939d3342bebc7eaf6528a8","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61939d3342bebc7eaf6528a8: done: 0.014008 sec","job_status":"done","queue_duration_s":1.670862,"scheduling_latency_s":1.670877,"redis_calls":13,"redis_duration_s":0.001399,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000493,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009716,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014008,"completed_at":"2026-09-06T15:24:07.931Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 234.012836] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.932Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"362256dd1e08e86538b447d5","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-362256dd1e08e86538b447d5: start","job_status":"start","queue_duration_s":1.685929,"scheduling_latency_s":1.685945}1389gitlab # [ 234.025136] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.946Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"362256dd1e08e86538b447d5","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-362256dd1e08e86538b447d5: done: 0.01394 sec","job_status":"done","queue_duration_s":1.685929,"scheduling_latency_s":1.685945,"redis_calls":13,"redis_duration_s":0.001389,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009665,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01394,"completed_at":"2026-09-06T15:24:07.946Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 234.065052] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.947Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00e9009e3b0257cafd02674f","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00e9009e3b0257cafd02674f: start","job_status":"start","queue_duration_s":1.700997,"scheduling_latency_s":1.701013}1391gitlab # [ 234.077965] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.961Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00e9009e3b0257cafd02674f","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00e9009e3b0257cafd02674f: done: 0.014007 sec","job_status":"done","queue_duration_s":1.700997,"scheduling_latency_s":1.701013,"redis_calls":13,"redis_duration_s":0.001398,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000902,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009731,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014007,"completed_at":"2026-09-06T15:24:07.961Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 234.117106] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54e80ed792346106864f6642","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54e80ed792346106864f6642: start","job_status":"start","queue_duration_s":1.716126,"scheduling_latency_s":1.716141}1393gitlab # [ 234.129853] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.977Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54e80ed792346106864f6642","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54e80ed792346106864f6642: done: 0.014572 sec","job_status":"done","queue_duration_s":1.716126,"scheduling_latency_s":1.716141,"redis_calls":13,"redis_duration_s":0.0017439999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001205,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014572,"completed_at":"2026-09-06T15:24:07.977Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 234.169285] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.978Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66790c174a35dc5ddae6aa8b","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66790c174a35dc5ddae6aa8b: start","job_status":"start","queue_duration_s":1.731806,"scheduling_latency_s":1.731822}1395gitlab # [ 234.181628] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:24:07.992Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66790c174a35dc5ddae6aa8b","created_at":"2026-09-06T15:24:06.152Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-bb6fbb2a5d9a4010","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dbece2e1535ad722051015a5bd654dda","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:24:06.246Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66790c174a35dc5ddae6aa8b: done: 0.014008 sec","job_status":"done","queue_duration_s":1.731806,"scheduling_latency_s":1.731822,"redis_calls":13,"redis_duration_s":0.001402,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014008,"completed_at":"2026-09-06T15:24:07.992Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 264.547640] setup-gitlab-start[2905]: W, [2026-09-06T15:24:40.399499 #2905] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1397gitlab # [ 289.130948] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:04.982Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"f220f1029091008fa386d627","created_at":"2026-09-06T15:25:04.910Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4bf0cb0f6e38aeec2dedd28c58f22286","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:04.978Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-f220f1029091008fa386d627: start","job_status":"start","queue_duration_s":0.003148,"scheduling_latency_s":0.003193}1398gitlab # [ 289.302577] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:05.155Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1399gitlab # [ 289.368209] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:05.220Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"f220f1029091008fa386d627","created_at":"2026-09-06T15:25:04.910Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4bf0cb0f6e38aeec2dedd28c58f22286","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:04.978Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-f220f1029091008fa386d627: done: 0.237993 sec","job_status":"done","queue_duration_s":0.003148,"scheduling_latency_s":0.003193,"redis_calls":16,"redis_duration_s":0.061382000000000006,"redis_read_bytes":1033,"redis_write_bytes":1341,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.048535,"redis_feature_flag_read_bytes":1028,"redis_feature_flag_write_bytes":570,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009324,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003523,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.237993,"completed_at":"2026-09-06T15:25:05.219Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 289.449024] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:05.230Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"becdfef51bbe5e59b97df603","created_at":"2026-09-06T15:25:04.998Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a5be3a0f0bef92931e49ac244bf720b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.005Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-becdfef51bbe5e59b97df603: start","job_status":"start","queue_duration_s":0.224783,"scheduling_latency_s":0.224833}1401gitlab # [ 289.494510] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:05.347Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1402gitlab # [ 289.520248] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:05.372Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"becdfef51bbe5e59b97df603","created_at":"2026-09-06T15:25:04.998Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a5be3a0f0bef92931e49ac244bf720b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.005Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-becdfef51bbe5e59b97df603: done: 0.141653 sec","job_status":"done","queue_duration_s":0.224783,"scheduling_latency_s":0.224833,"redis_calls":8,"redis_duration_s":0.011462,"redis_read_bytes":133,"redis_write_bytes":867,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00132,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":101,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00702,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003122,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025762,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.141653,"completed_at":"2026-09-06T15:25:05.372Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 289.598652] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:05.392Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"2760c2d5d2e83d2144d012a1","created_at":"2026-09-06T15:25:05.016Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f8ef94ca258b71784310e035471b6cd4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.023Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-2760c2d5d2e83d2144d012a1: start","job_status":"start","queue_duration_s":0.369423,"scheduling_latency_s":0.369471}1404gitlab # [ 289.829933] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:05.681Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"2760c2d5d2e83d2144d012a1","created_at":"2026-09-06T15:25:05.016Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f8ef94ca258b71784310e035471b6cd4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.023Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-2760c2d5d2e83d2144d012a1: done: 0.288892 sec","job_status":"done","queue_duration_s":0.369423,"scheduling_latency_s":0.369471,"redis_calls":10,"redis_duration_s":0.028556,"redis_read_bytes":135,"redis_write_bytes":1275,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00143,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":106,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.020802,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.006324,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.064,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.064,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.062049,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00265542,"exclusive_lock_hold_duration_s":0.0483811,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.288892,"completed_at":"2026-09-06T15:25:05.681Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.2528,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405gitlab # [ 289.919642] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:05.685Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"ec89af1525c8d517b5d8a195","created_at":"2026-09-06T15:25:05.041Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12bd255074ae129cf7883b469deb49f3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.047Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-ec89af1525c8d517b5d8a195: start","job_status":"start","queue_duration_s":0.637981,"scheduling_latency_s":0.638032}1406gitlab # [ 289.983502] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:05.835Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"ec89af1525c8d517b5d8a195","created_at":"2026-09-06T15:25:05.041Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12bd255074ae129cf7883b469deb49f3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.047Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-ec89af1525c8d517b5d8a195: done: 0.150155 sec","job_status":"done","queue_duration_s":0.637981,"scheduling_latency_s":0.638032,"redis_calls":11,"redis_duration_s":0.003982,"redis_read_bytes":263,"redis_write_bytes":1334,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000581,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":172,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001861,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00154,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.032,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.061322,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00115108,"exclusive_lock_hold_duration_s":0.10980712,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.150155,"completed_at":"2026-09-06T15:25:05.835Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.092451,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 290.072378] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:05.840Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"f192c75d088f39cf5c10f112","created_at":"2026-09-06T15:25:05.057Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0437755191e10bfae38f135a046d3f0a","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.065Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-f192c75d088f39cf5c10f112: start","job_status":"start","queue_duration_s":0.774929,"scheduling_latency_s":0.774981}1408gitlab # [ 290.410517] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.262Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"f192c75d088f39cf5c10f112","created_at":"2026-09-06T15:25:05.057Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0437755191e10bfae38f135a046d3f0a","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.065Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-f192c75d088f39cf5c10f112: done: 0.422232 sec","job_status":"done","queue_duration_s":0.774929,"scheduling_latency_s":0.774981,"redis_calls":563,"redis_duration_s":0.103714,"redis_read_bytes":688,"redis_write_bytes":48843,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00036,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":83,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001774,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.10158,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.360629,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.422232,"completed_at":"2026-09-06T15:25:06.262Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 290.486570] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.263Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"25d38ebf57fe6c4d171b08f3","created_at":"2026-09-06T15:25:05.071Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a5589344976e10c0f79e80b2d311374","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.081Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-25d38ebf57fe6c4d171b08f3: start","job_status":"start","queue_duration_s":1.182688,"scheduling_latency_s":1.182708}1410gitlab # [ 290.502660] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.287Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"25d38ebf57fe6c4d171b08f3","created_at":"2026-09-06T15:25:05.071Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a5589344976e10c0f79e80b2d311374","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.081Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-25d38ebf57fe6c4d171b08f3: done: 0.023969 sec","job_status":"done","queue_duration_s":1.182688,"scheduling_latency_s":1.182708,"redis_calls":9,"redis_duration_s":0.0025,"redis_read_bytes":261,"redis_write_bytes":813,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000449,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":132,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001503,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000548,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023969,"completed_at":"2026-09-06T15:25:06.287Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002928,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 290.545115] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.289Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"4a3099e52cf8a3ce51a60a96","created_at":"2026-09-06T15:25:05.135Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99149cd51c8259148e507754036d2a46","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.149Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-4a3099e52cf8a3ce51a60a96: start","job_status":"start","queue_duration_s":1.140607,"scheduling_latency_s":1.140626}1412gitlab # [ 290.559715] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.299Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1413gitlab # [ 290.563738] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.304Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"4a3099e52cf8a3ce51a60a96","created_at":"2026-09-06T15:25:05.135Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99149cd51c8259148e507754036d2a46","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.149Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-4a3099e52cf8a3ce51a60a96: done: 0.014889 sec","job_status":"done","queue_duration_s":1.140607,"scheduling_latency_s":1.140626,"redis_calls":8,"redis_duration_s":0.0018780000000000001,"redis_read_bytes":133,"redis_write_bytes":931,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00022,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001173,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000485,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008704,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014889,"completed_at":"2026-09-06T15:25:06.304Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 290.606352] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.306Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"b75d31252fb4c0b8e7e54d0d","created_at":"2026-09-06T15:25:05.172Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a0d2e42799724937a41034a20c6e06c9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.187Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-b75d31252fb4c0b8e7e54d0d: start","job_status":"start","queue_duration_s":1.119014,"scheduling_latency_s":1.119031}1415gitlab # [ 290.619739] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.325Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"b75d31252fb4c0b8e7e54d0d","created_at":"2026-09-06T15:25:05.172Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a0d2e42799724937a41034a20c6e06c9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.187Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-b75d31252fb4c0b8e7e54d0d: done: 0.019519 sec","job_status":"done","queue_duration_s":1.119014,"scheduling_latency_s":1.119031,"redis_calls":10,"redis_duration_s":0.002565,"redis_read_bytes":135,"redis_write_bytes":1167,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000241,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":95,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001199,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001125,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012204,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00060644,"exclusive_lock_hold_duration_s":0.0043655,"duration_s":0.019519,"completed_at":"2026-09-06T15:25:06.325Z","load_balancing_strategy":"primary","db_duration_s":0.001913,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 290.661000] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.327Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"46ca3f7fa18b52f96d3f0bd7","created_at":"2026-09-06T15:25:05.212Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5e053b14b0c89fa2926b91ed0d5c932","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.223Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-46ca3f7fa18b52f96d3f0bd7: start","job_status":"start","queue_duration_s":1.104048,"scheduling_latency_s":1.104062}1417gitlab # [ 290.674375] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.357Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"46ca3f7fa18b52f96d3f0bd7","created_at":"2026-09-06T15:25:05.212Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5e053b14b0c89fa2926b91ed0d5c932","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.223Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-46ca3f7fa18b52f96d3f0bd7: done: 0.02996 sec","job_status":"done","queue_duration_s":1.104048,"scheduling_latency_s":1.104062,"redis_calls":16,"redis_duration_s":0.004082,"redis_read_bytes":272,"redis_write_bytes":4229,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000467,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":199,"redis_queues_calls":2,"redis_queues_duration_s":0.000427,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002388,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.0008,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021303,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02996,"completed_at":"2026-09-06T15:25:06.357Z","load_balancing_strategy":"primary","db_duration_s":0.002429,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 290.716831] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.358Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"95ef6a0e2cd0cf4bf465b480","created_at":"2026-09-06T15:25:05.261Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3132b60793e314c4041caf7b34b8432d","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.266Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-95ef6a0e2cd0cf4bf465b480: start","job_status":"start","queue_duration_s":1.091998,"scheduling_latency_s":1.092013}1419gitlab # [ 290.731484] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.384Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"95ef6a0e2cd0cf4bf465b480","created_at":"2026-09-06T15:25:05.261Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3132b60793e314c4041caf7b34b8432d","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.266Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-95ef6a0e2cd0cf4bf465b480: done: 0.025523 sec","job_status":"done","queue_duration_s":1.091998,"scheduling_latency_s":1.092013,"redis_calls":11,"redis_duration_s":0.003038,"redis_read_bytes":517,"redis_write_bytes":1011,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001053,"redis_feature_flag_read_bytes":512,"redis_feature_flag_write_bytes":300,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001188,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000797,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025523,"completed_at":"2026-09-06T15:25:06.384Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006461,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 290.774543] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.385Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"a5b8d6f0dfd6d1cca81fa60c","created_at":"2026-09-06T15:25:05.286Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f19c72b37d9031c8cadfb7f16c2df24e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-06T15:25:05.290Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-a5b8d6f0dfd6d1cca81fa60c: start","job_status":"start","queue_duration_s":1.094894,"scheduling_latency_s":1.094909}1421gitlab # [ 290.788125] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.394Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1422gitlab # [ 290.791806] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.399Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"a5b8d6f0dfd6d1cca81fa60c","created_at":"2026-09-06T15:25:05.286Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f19c72b37d9031c8cadfb7f16c2df24e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-06T15:25:05.290Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-a5b8d6f0dfd6d1cca81fa60c: done: 0.013801 sec","job_status":"done","queue_duration_s":1.094894,"scheduling_latency_s":1.094909,"redis_calls":8,"redis_duration_s":0.001814,"redis_read_bytes":133,"redis_write_bytes":908,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000214,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":107,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001149,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000451,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013801,"completed_at":"2026-09-06T15:25:06.399Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 290.833055] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.401Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::JiraImport::StuckJiraImportJobsWorker","jid":"0596f51af8acfd5fb7135732","created_at":"2026-09-06T15:25:05.298Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7ff3d9ac282359ba522a25f55ad8b0ea","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b9cf6c9b6c2f8fad80e08693d59af787bb65ad6ffe24ec5d0e1a669517566127","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.302Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::JiraImport::StuckJiraImportJobsWorker JID-0596f51af8acfd5fb7135732: start","job_status":"start","queue_duration_s":1.099089,"scheduling_latency_s":1.099103}1424gitlab # [ 290.846541] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.420Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::JiraImport::StuckJiraImportJobsWorker","jid":"0596f51af8acfd5fb7135732","created_at":"2026-09-06T15:25:05.298Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7ff3d9ac282359ba522a25f55ad8b0ea","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b9cf6c9b6c2f8fad80e08693d59af787bb65ad6ffe24ec5d0e1a669517566127","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.302Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::JiraImport::StuckJiraImportJobsWorker JID-0596f51af8acfd5fb7135732: done: 0.019578 sec","job_status":"done","queue_duration_s":1.099089,"scheduling_latency_s":1.099103,"redis_calls":8,"redis_duration_s":0.002006,"redis_read_bytes":133,"redis_write_bytes":859,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000213,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":98,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001303,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00049,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01201,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019578,"completed_at":"2026-09-06T15:25:06.420Z","load_balancing_strategy":"primary","db_duration_s":0.002719,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 290.887957] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.422Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"4509949083f574b6c64e5c8c","created_at":"2026-09-06T15:25:05.317Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.322Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-4509949083f574b6c64e5c8c: start","job_status":"start","queue_duration_s":1.10034,"scheduling_latency_s":1.100355}1426gitlab # [ 290.901476] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.579Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"4509949083f574b6c64e5c8c","created_at":"2026-09-06T15:25:05.317Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.322Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-4509949083f574b6c64e5c8c: done: 0.157145 sec","job_status":"done","queue_duration_s":1.10034,"scheduling_latency_s":1.100355,"redis_calls":65,"redis_duration_s":0.017133,"redis_read_bytes":748,"redis_write_bytes":41502,"redis_feature_flag_calls":5,"redis_feature_flag_duration_s":0.001043,"redis_feature_flag_read_bytes":640,"redis_feature_flag_write_bytes":393,"redis_queues_calls":2,"redis_queues_duration_s":0.000635,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.014848,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000607,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.145343,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.157145,"completed_at":"2026-09-06T15:25:06.579Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 290.944183] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.580Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"c511f5e67aa5c8b995b0b877","created_at":"2026-09-06T15:25:05.344Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0e1f2799e4b7741ee18052804c633f8e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-06T15:25:05.366Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-c511f5e67aa5c8b995b0b877: start","job_status":"start","queue_duration_s":1.214891,"scheduling_latency_s":1.214909}1428gitlab # [ 290.957408] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.604Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"c511f5e67aa5c8b995b0b877","created_at":"2026-09-06T15:25:05.344Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0e1f2799e4b7741ee18052804c633f8e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-06T15:25:05.366Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-c511f5e67aa5c8b995b0b877: done: 0.024016 sec","job_status":"done","queue_duration_s":1.214891,"scheduling_latency_s":1.214909,"redis_calls":9,"redis_duration_s":0.00147,"redis_read_bytes":261,"redis_write_bytes":906,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000323,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":165,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000842,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000305,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017168,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024016,"completed_at":"2026-09-06T15:25:06.604Z","load_balancing_strategy":"primary","db_duration_s":0.00174,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 290.998959] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.606Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"5fddb4f02bad7d24ce7b0e19","created_at":"2026-09-06T15:25:05.386Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"db9fc593749cc0192563d9bef8e28bc3","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.413Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-5fddb4f02bad7d24ce7b0e19: start","job_status":"start","queue_duration_s":1.192254,"scheduling_latency_s":1.19227}1430gitlab # [ 291.013183] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.627Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"5fddb4f02bad7d24ce7b0e19","created_at":"2026-09-06T15:25:05.386Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"db9fc593749cc0192563d9bef8e28bc3","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.413Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-5fddb4f02bad7d24ce7b0e19: done: 0.021184 sec","job_status":"done","queue_duration_s":1.192254,"scheduling_latency_s":1.19227,"redis_calls":11,"redis_duration_s":0.0016640000000000001,"redis_read_bytes":9,"redis_write_bytes":1174,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000332,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000778,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000265,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000289,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024636,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.021184,"completed_at":"2026-09-06T15:25:06.627Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001024,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 291.057168] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.628Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"3884d201f22aeff5193674c8","created_at":"2026-09-06T15:25:05.473Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f1f1ccf44c5c401349b6620e2d7a96fb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-06T15:25:05.480Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-3884d201f22aeff5193674c8: start","job_status":"start","queue_duration_s":1.14781,"scheduling_latency_s":1.147826}1432gitlab # [ 291.070675] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.636Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1433gitlab # [ 291.074065] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.642Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"3884d201f22aeff5193674c8","created_at":"2026-09-06T15:25:05.473Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f1f1ccf44c5c401349b6620e2d7a96fb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-06T15:25:05.480Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-3884d201f22aeff5193674c8: done: 0.013764 sec","job_status":"done","queue_duration_s":1.14781,"scheduling_latency_s":1.147826,"redis_calls":8,"redis_duration_s":0.0014140000000000001,"redis_read_bytes":133,"redis_write_bytes":914,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000119,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":108,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001025,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00027,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013764,"completed_at":"2026-09-06T15:25:06.642Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 291.115057] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.643Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"4c363bf1755edcdf417c1845","created_at":"2026-09-06T15:25:05.532Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1f6bed208e52cfad4a51a5e9fde487b4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.537Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-4c363bf1755edcdf417c1845: start","job_status":"start","queue_duration_s":1.105726,"scheduling_latency_s":1.105743}1435gitlab # [ 291.129299] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.904Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"4c363bf1755edcdf417c1845","created_at":"2026-09-06T15:25:05.532Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1f6bed208e52cfad4a51a5e9fde487b4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.537Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-4c363bf1755edcdf417c1845: done: 0.261163 sec","job_status":"done","queue_duration_s":1.105726,"scheduling_latency_s":1.105743,"redis_calls":10,"redis_duration_s":0.0015530000000000001,"redis_read_bytes":135,"redis_write_bytes":1071,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000123,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":84,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000768,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000662,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.05,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.05,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.194981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00049688,"exclusive_lock_hold_duration_s":0.2449035,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.261163,"completed_at":"2026-09-06T15:25:06.904Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.076255,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 291.172716] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.906Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"2cc7629877cbec1dccf89618","created_at":"2026-09-06T15:25:05.543Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"81656848a0ed2a8d055b736368707da5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.548Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-2cc7629877cbec1dccf89618: start","job_status":"start","queue_duration_s":1.357821,"scheduling_latency_s":1.357843}1437gitlab # [ 291.187965] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.914Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1438gitlab # [ 291.191449] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.920Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"2cc7629877cbec1dccf89618","created_at":"2026-09-06T15:25:05.543Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"81656848a0ed2a8d055b736368707da5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.548Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-2cc7629877cbec1dccf89618: done: 0.01441 sec","job_status":"done","queue_duration_s":1.357821,"scheduling_latency_s":1.357843,"redis_calls":8,"redis_duration_s":0.001095,"redis_read_bytes":133,"redis_write_bytes":937,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000129,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":111,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000688,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000278,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009364,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01441,"completed_at":"2026-09-06T15:25:06.920Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 291.232712] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.921Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"4103d1fe127594918ff77045","created_at":"2026-09-06T15:25:05.555Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eb7e1abc00eddfeaf03db70edaec5861","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.560Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-4103d1fe127594918ff77045: start","job_status":"start","queue_duration_s":1.361273,"scheduling_latency_s":1.361291}1440gitlab # [ 291.246860] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.942Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"4103d1fe127594918ff77045","created_at":"2026-09-06T15:25:05.555Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eb7e1abc00eddfeaf03db70edaec5861","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.560Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-4103d1fe127594918ff77045: done: 0.021168 sec","job_status":"done","queue_duration_s":1.361273,"scheduling_latency_s":1.361291,"redis_calls":11,"redis_duration_s":0.00169,"redis_read_bytes":136,"redis_write_bytes":1339,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000126,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":100,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000969,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000595,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014237,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00501688,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.021168,"completed_at":"2026-09-06T15:25:06.942Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002241,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1441gitlab # [ 291.289898] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.944Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9677ec68704a74d6c1553549","created_at":"2026-09-06T15:25:05.569Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"36b31f8e1519efa4d1b191d5cb096256","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.577Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9677ec68704a74d6c1553549: start","job_status":"start","queue_duration_s":1.366715,"scheduling_latency_s":1.366733}1442gitlab # [ 291.304233] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.958Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9677ec68704a74d6c1553549","created_at":"2026-09-06T15:25:05.569Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"36b31f8e1519efa4d1b191d5cb096256","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.577Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9677ec68704a74d6c1553549: done: 0.014241 sec","job_status":"done","queue_duration_s":1.366715,"scheduling_latency_s":1.366733,"redis_calls":9,"redis_duration_s":0.001179,"redis_read_bytes":261,"redis_write_bytes":1008,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000248,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":177,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000658,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000273,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009381,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014241,"completed_at":"2026-09-06T15:25:06.958Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 291.345573] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.959Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"00e93f4a619fe4d03f279dbe","created_at":"2026-09-06T15:25:05.594Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"58107b9d9832ed00450f2bede1a7d173","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.601Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-00e93f4a619fe4d03f279dbe: start","job_status":"start","queue_duration_s":1.357905,"scheduling_latency_s":1.357923}1444gitlab # [ 291.359170] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.981Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"00e93f4a619fe4d03f279dbe","created_at":"2026-09-06T15:25:05.594Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"58107b9d9832ed00450f2bede1a7d173","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.601Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-00e93f4a619fe4d03f279dbe: done: 0.021901 sec","job_status":"done","queue_duration_s":1.357905,"scheduling_latency_s":1.357923,"redis_calls":8,"redis_duration_s":0.001136,"redis_read_bytes":133,"redis_write_bytes":936,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000116,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000746,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000274,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010282,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.021901,"completed_at":"2026-09-06T15:25:06.981Z","load_balancing_strategy":"primary","db_duration_s":0.007095,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 291.401611] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.982Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"0256808c2e9565e9bf1901f0","created_at":"2026-09-06T15:25:05.609Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2212e9cc617c48af4c2a426b73799a96","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.615Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-0256808c2e9565e9bf1901f0: start","job_status":"start","queue_duration_s":1.367058,"scheduling_latency_s":1.367076}1446gitlab # [ 291.415985] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.998Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"0256808c2e9565e9bf1901f0","created_at":"2026-09-06T15:25:05.609Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2212e9cc617c48af4c2a426b73799a96","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.615Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-0256808c2e9565e9bf1901f0: done: 0.015639 sec","job_status":"done","queue_duration_s":1.367058,"scheduling_latency_s":1.367076,"redis_calls":9,"redis_duration_s":0.0012439999999999999,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000656,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000588,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010184,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0004539,"exclusive_lock_hold_duration_s":0.00246352,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.015639,"completed_at":"2026-09-06T15:25:06.998Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000874,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 291.458142] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:06.999Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"0c2971d3ed4aaabd5cf2692f","created_at":"2026-09-06T15:25:05.625Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51f6e1709b75aad7249b866430a608f4","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.632Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-0c2971d3ed4aaabd5cf2692f: start","job_status":"start","queue_duration_s":1.366587,"scheduling_latency_s":1.366605}1448gitlab # [ 291.471323] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.045Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"0c2971d3ed4aaabd5cf2692f","created_at":"2026-09-06T15:25:05.625Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51f6e1709b75aad7249b866430a608f4","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.632Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-0c2971d3ed4aaabd5cf2692f: done: 0.045584 sec","job_status":"done","queue_duration_s":1.366587,"scheduling_latency_s":1.366605,"redis_calls":10,"redis_duration_s":0.001909,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000272,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001216,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000421,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029137,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00063388,"duration_s":0.045584,"completed_at":"2026-09-06T15:25:07.045Z","load_balancing_strategy":"primary","db_duration_s":0.005466,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 291.512740] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.048Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"b972db75dd3d42511c41c801","created_at":"2026-09-06T15:25:05.644Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ab280e543be8681e15cc8b83cfeeea6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.649Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-b972db75dd3d42511c41c801: start","job_status":"start","queue_duration_s":1.398615,"scheduling_latency_s":1.398661}1450gitlab # [ 291.527198] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.082Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"b972db75dd3d42511c41c801","created_at":"2026-09-06T15:25:05.644Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-01f0eef04de44ff7","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ab280e543be8681e15cc8b83cfeeea6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-06T15:25:05.649Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-b972db75dd3d42511c41c801: done: 0.034127 sec","job_status":"done","queue_duration_s":1.398615,"scheduling_latency_s":1.398661,"redis_calls":8,"redis_duration_s":0.002666,"redis_read_bytes":133,"redis_write_bytes":879,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000278,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":103,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001792,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000596,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034127,"completed_at":"2026-09-06T15:25:07.082Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 291.569756] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.085Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d724026fe07a175f2301775f","created_at":"2026-09-06T15:25:06.340Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-9579a33cd71147c1","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d5e053b14b0c89fa2926b91ed0d5c932","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.351Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d724026fe07a175f2301775f: start","job_status":"start","queue_duration_s":0.734175,"scheduling_latency_s":0.734207}1452gitlab # [ 291.582191] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.110Z","message":"No existing merge request to be cleaned up."}1453gitlab # [ 291.583865] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.127Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d724026fe07a175f2301775f","created_at":"2026-09-06T15:25:06.340Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-9579a33cd71147c1","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d5e053b14b0c89fa2926b91ed0d5c932","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.351Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d724026fe07a175f2301775f: done: 0.042576 sec","job_status":"done","queue_duration_s":0.734175,"scheduling_latency_s":0.734207,"redis_calls":11,"redis_duration_s":0.003922,"redis_read_bytes":136,"redis_write_bytes":1104,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000303,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":82,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001572,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002047,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030144,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042576,"completed_at":"2026-09-06T15:25:07.127Z","load_balancing_strategy":"primary","db_duration_s":0.003813,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 291.624856] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.130Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"323cfda2ae7b22042821dbae","created_at":"2026-09-06T15:25:06.340Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-9579a33cd71147c1","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d5e053b14b0c89fa2926b91ed0d5c932","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.351Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-323cfda2ae7b22042821dbae: start","job_status":"start","queue_duration_s":0.779408,"scheduling_latency_s":0.779437}1455gitlab # [ 291.637160] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.150Z","message":"No existing merge request to be cleaned up."}1456gitlab # [ 291.638827] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.163Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"323cfda2ae7b22042821dbae","created_at":"2026-09-06T15:25:06.340Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-9579a33cd71147c1","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d5e053b14b0c89fa2926b91ed0d5c932","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.351Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-323cfda2ae7b22042821dbae: done: 0.032884 sec","job_status":"done","queue_duration_s":0.779408,"scheduling_latency_s":0.779437,"redis_calls":10,"redis_duration_s":0.003544,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001255,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002289,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032884,"completed_at":"2026-09-06T15:25:07.163Z","load_balancing_strategy":"primary","db_duration_s":0.003028,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 291.677247] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.165Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4b77fca52c84dbe42926b72d","created_at":"2026-09-06T15:25:06.340Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-9579a33cd71147c1","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d5e053b14b0c89fa2926b91ed0d5c932","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.351Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4b77fca52c84dbe42926b72d: start","job_status":"start","queue_duration_s":0.814393,"scheduling_latency_s":0.814418}1458gitlab # [ 291.689618] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.181Z","message":"No existing merge request to be cleaned up."}1459gitlab # [ 291.691268] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.192Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4b77fca52c84dbe42926b72d","created_at":"2026-09-06T15:25:06.340Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-9579a33cd71147c1","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d5e053b14b0c89fa2926b91ed0d5c932","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.351Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4b77fca52c84dbe42926b72d: done: 0.026879 sec","job_status":"done","queue_duration_s":0.814393,"scheduling_latency_s":0.814418,"redis_calls":10,"redis_duration_s":0.002928,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001258,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00167,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017599,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026879,"completed_at":"2026-09-06T15:25:07.192Z","load_balancing_strategy":"primary","db_duration_s":0.002646,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 291.730469] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.194Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"20498c334fe576a433d0cc44","created_at":"2026-09-06T15:25:06.340Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-9579a33cd71147c1","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d5e053b14b0c89fa2926b91ed0d5c932","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.351Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-20498c334fe576a433d0cc44: start","job_status":"start","queue_duration_s":0.843072,"scheduling_latency_s":0.843091}1461gitlab # [ 291.742972] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.208Z","message":"No existing merge request to be cleaned up."}1462gitlab # [ 291.744713] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.218Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"20498c334fe576a433d0cc44","created_at":"2026-09-06T15:25:06.340Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-9579a33cd71147c1","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d5e053b14b0c89fa2926b91ed0d5c932","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.351Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-20498c334fe576a433d0cc44: done: 0.024537 sec","job_status":"done","queue_duration_s":0.843072,"scheduling_latency_s":0.843091,"redis_calls":10,"redis_duration_s":0.002716,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001144,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001572,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016219,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024537,"completed_at":"2026-09-06T15:25:07.218Z","load_balancing_strategy":"primary","db_duration_s":0.002634,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 291.783656] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.220Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0855684a42e03013e6e537b","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0855684a42e03013e6e537b: start","job_status":"start","queue_duration_s":0.648666,"scheduling_latency_s":0.648684}1464gitlab # [ 291.797521] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.240Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0855684a42e03013e6e537b","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0855684a42e03013e6e537b: done: 0.019487 sec","job_status":"done","queue_duration_s":0.648666,"scheduling_latency_s":0.648684,"redis_calls":14,"redis_duration_s":0.003178,"redis_read_bytes":138,"redis_write_bytes":1242,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000259,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":85,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001016,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012726,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019487,"completed_at":"2026-09-06T15:25:07.239Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465gitlab # [ 291.839179] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c4c22e798767d7f891c69f0","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c4c22e798767d7f891c69f0: start","job_status":"start","queue_duration_s":0.669696,"scheduling_latency_s":0.669713}1466gitlab # [ 291.852224] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.257Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c4c22e798767d7f891c69f0","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c4c22e798767d7f891c69f0: done: 0.016145 sec","job_status":"done","queue_duration_s":0.669696,"scheduling_latency_s":0.669713,"redis_calls":13,"redis_duration_s":0.002665,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000923,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001742,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016145,"completed_at":"2026-09-06T15:25:07.257Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1467gitlab # [ 291.892863] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.259Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40f0f5bbbaeffcbd97c309b4","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40f0f5bbbaeffcbd97c309b4: start","job_status":"start","queue_duration_s":0.687227,"scheduling_latency_s":0.687242}1468gitlab # [ 291.905158] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40f0f5bbbaeffcbd97c309b4","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40f0f5bbbaeffcbd97c309b4: done: 0.01505 sec","job_status":"done","queue_duration_s":0.687227,"scheduling_latency_s":0.687242,"redis_calls":13,"redis_duration_s":0.002682,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000896,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001786,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009467,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01505,"completed_at":"2026-09-06T15:25:07.274Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1469gitlab # [ 291.944555] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.275Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"908be267d967740caca80ec9","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-908be267d967740caca80ec9: start","job_status":"start","queue_duration_s":0.70368,"scheduling_latency_s":0.703694}1470gitlab # [ 291.956960] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.290Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"908be267d967740caca80ec9","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-908be267d967740caca80ec9: done: 0.014976 sec","job_status":"done","queue_duration_s":0.70368,"scheduling_latency_s":0.703694,"redis_calls":13,"redis_duration_s":0.002698,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001783,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009407,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014976,"completed_at":"2026-09-06T15:25:07.290Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1471gitlab # [ 291.997433] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.291Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86603a6a46d8ee1fd3a59754","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86603a6a46d8ee1fd3a59754: start","job_status":"start","queue_duration_s":0.719978,"scheduling_latency_s":0.719992}1472gitlab # [ 292.010819] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86603a6a46d8ee1fd3a59754","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86603a6a46d8ee1fd3a59754: done: 0.014832 sec","job_status":"done","queue_duration_s":0.719978,"scheduling_latency_s":0.719992,"redis_calls":13,"redis_duration_s":0.002443,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001559,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014832,"completed_at":"2026-09-06T15:25:07.306Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1473gitlab # [ 292.049979] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.308Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1fe0b56d0011af15470a6094","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1fe0b56d0011af15470a6094: start","job_status":"start","queue_duration_s":0.73623,"scheduling_latency_s":0.736244}1474gitlab # [ 292.062563] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1fe0b56d0011af15470a6094","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1fe0b56d0011af15470a6094: done: 0.015326 sec","job_status":"done","queue_duration_s":0.73623,"scheduling_latency_s":0.736244,"redis_calls":13,"redis_duration_s":0.0027359999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001004,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001732,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009756,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015326,"completed_at":"2026-09-06T15:25:07.323Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1475gitlab # [ 292.103249] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.332Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3cc2c80176bb373c1bdc3000","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3cc2c80176bb373c1bdc3000: start","job_status":"start","queue_duration_s":0.760583,"scheduling_latency_s":0.760599}1476gitlab # [ 292.115940] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.347Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3cc2c80176bb373c1bdc3000","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3cc2c80176bb373c1bdc3000: done: 0.015466 sec","job_status":"done","queue_duration_s":0.760583,"scheduling_latency_s":0.760599,"redis_calls":13,"redis_duration_s":0.002693,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000964,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001729,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009791,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015466,"completed_at":"2026-09-06T15:25:07.347Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477gitlab # [ 292.155560] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ade84e75ec54656f5ef2ec0","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ade84e75ec54656f5ef2ec0: start","job_status":"start","queue_duration_s":0.777416,"scheduling_latency_s":0.77743}1478gitlab # [ 292.168139] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.364Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ade84e75ec54656f5ef2ec0","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ade84e75ec54656f5ef2ec0: done: 0.015226 sec","job_status":"done","queue_duration_s":0.777416,"scheduling_latency_s":0.77743,"redis_calls":13,"redis_duration_s":0.002685,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000904,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001781,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009641,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015226,"completed_at":"2026-09-06T15:25:07.364Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479gitlab # [ 292.208478] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.365Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6d84bd839fd14f19e760e60","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6d84bd839fd14f19e760e60: start","job_status":"start","queue_duration_s":0.793906,"scheduling_latency_s":0.793921}1480gitlab # [ 292.221058] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.392Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6d84bd839fd14f19e760e60","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6d84bd839fd14f19e760e60: done: 0.026909 sec","job_status":"done","queue_duration_s":0.793906,"scheduling_latency_s":0.793921,"redis_calls":13,"redis_duration_s":0.002872,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000984,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001888,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021175,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026909,"completed_at":"2026-09-06T15:25:07.392Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481gitlab # [ 292.262030] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.394Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c836fb07b6f36d65a471d20","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c836fb07b6f36d65a471d20: start","job_status":"start","queue_duration_s":0.822217,"scheduling_latency_s":0.822231}1482gitlab # [ 292.274283] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c836fb07b6f36d65a471d20","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c836fb07b6f36d65a471d20: done: 0.014707 sec","job_status":"done","queue_duration_s":0.822217,"scheduling_latency_s":0.822231,"redis_calls":13,"redis_duration_s":0.002206,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000724,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001482,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009632,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014707,"completed_at":"2026-09-06T15:25:07.408Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1483gitlab # [ 292.313413] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4655a293e8696696b5b17acb","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4655a293e8696696b5b17acb: start","job_status":"start","queue_duration_s":0.838046,"scheduling_latency_s":0.838061}1484gitlab # [ 292.325877] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.424Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4655a293e8696696b5b17acb","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4655a293e8696696b5b17acb: done: 0.014237 sec","job_status":"done","queue_duration_s":0.838046,"scheduling_latency_s":0.838061,"redis_calls":13,"redis_duration_s":0.0015769999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001052,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014237,"completed_at":"2026-09-06T15:25:07.424Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485gitlab # [ 292.365971] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc633e42b753a61f8c938fbd","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc633e42b753a61f8c938fbd: start","job_status":"start","queue_duration_s":0.853337,"scheduling_latency_s":0.853371}1486gitlab # [ 292.378454] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc633e42b753a61f8c938fbd","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc633e42b753a61f8c938fbd: done: 0.014345 sec","job_status":"done","queue_duration_s":0.853337,"scheduling_latency_s":0.853371,"redis_calls":13,"redis_duration_s":0.001531,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000557,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000974,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009908,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014345,"completed_at":"2026-09-06T15:25:07.439Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1487gitlab # [ 292.420231] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23e8050ed1aa78bf14f6ee00","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23e8050ed1aa78bf14f6ee00: start","job_status":"start","queue_duration_s":0.868732,"scheduling_latency_s":0.868747}1488gitlab # [ 292.457515] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.455Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23e8050ed1aa78bf14f6ee00","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23e8050ed1aa78bf14f6ee00: done: 0.014422 sec","job_status":"done","queue_duration_s":0.868732,"scheduling_latency_s":0.868747,"redis_calls":13,"redis_duration_s":0.001422,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009891,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014422,"completed_at":"2026-09-06T15:25:07.454Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1489gitlab # [ 292.525817] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.456Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ff67ed925f3a157a984a43f","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ff67ed925f3a157a984a43f: start","job_status":"start","queue_duration_s":0.884214,"scheduling_latency_s":0.884229}1490gitlab # [ 292.539749] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.470Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ff67ed925f3a157a984a43f","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ff67ed925f3a157a984a43f: done: 0.014051 sec","job_status":"done","queue_duration_s":0.884214,"scheduling_latency_s":0.884229,"redis_calls":13,"redis_duration_s":0.001402,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000883,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009731,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014051,"completed_at":"2026-09-06T15:25:07.470Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491gitlab # [ 292.579044] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.471Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fdabaad6579fdf4028aeb873","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fdabaad6579fdf4028aeb873: start","job_status":"start","queue_duration_s":0.899313,"scheduling_latency_s":0.899328}1492gitlab # [ 292.591433] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.485Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fdabaad6579fdf4028aeb873","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fdabaad6579fdf4028aeb873: done: 0.013948 sec","job_status":"done","queue_duration_s":0.899313,"scheduling_latency_s":0.899328,"redis_calls":13,"redis_duration_s":0.001395,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000892,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013948,"completed_at":"2026-09-06T15:25:07.485Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1493gitlab # [ 292.632717] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.486Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"386122f7de713c5f77f621f2","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-386122f7de713c5f77f621f2: start","job_status":"start","queue_duration_s":0.914385,"scheduling_latency_s":0.914402}1494gitlab # [ 292.669899] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.500Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"386122f7de713c5f77f621f2","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-386122f7de713c5f77f621f2: done: 0.014113 sec","job_status":"done","queue_duration_s":0.914385,"scheduling_latency_s":0.914402,"redis_calls":13,"redis_duration_s":0.001426,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000896,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014113,"completed_at":"2026-09-06T15:25:07.500Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1495gitlab # [ 292.739949] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.501Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e21ab524e5a3c8173ed6b9b","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e21ab524e5a3c8173ed6b9b: start","job_status":"start","queue_duration_s":0.929617,"scheduling_latency_s":0.929632}1496gitlab # [ 292.754312] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.515Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e21ab524e5a3c8173ed6b9b","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e21ab524e5a3c8173ed6b9b: done: 0.014241 sec","job_status":"done","queue_duration_s":0.929617,"scheduling_latency_s":0.929632,"redis_calls":13,"redis_duration_s":0.001426,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000896,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009853,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014241,"completed_at":"2026-09-06T15:25:07.515Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1497gitlab # [ 292.793488] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.516Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3bb3ca8f5028f9a66adbdda4","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3bb3ca8f5028f9a66adbdda4: start","job_status":"start","queue_duration_s":0.944953,"scheduling_latency_s":0.944968}1498gitlab # [ 292.805708] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.530Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3bb3ca8f5028f9a66adbdda4","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3bb3ca8f5028f9a66adbdda4: done: 0.013967 sec","job_status":"done","queue_duration_s":0.944953,"scheduling_latency_s":0.944968,"redis_calls":13,"redis_duration_s":0.001401,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009682,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013967,"completed_at":"2026-09-06T15:25:07.530Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1499gitlab # [ 292.847664] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.531Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36861082fee89097a14f4cd9","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36861082fee89097a14f4cd9: start","job_status":"start","queue_duration_s":0.960001,"scheduling_latency_s":0.960017}1500gitlab # [ 292.861154] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.545Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36861082fee89097a14f4cd9","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36861082fee89097a14f4cd9: done: 0.014041 sec","job_status":"done","queue_duration_s":0.960001,"scheduling_latency_s":0.960017,"redis_calls":13,"redis_duration_s":0.001382,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000885,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009726,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014041,"completed_at":"2026-09-06T15:25:07.545Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501gitlab # [ 292.899987] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.547Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7da6477a1b8e3078b9814b9c","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7da6477a1b8e3078b9814b9c: start","job_status":"start","queue_duration_s":0.975108,"scheduling_latency_s":0.975124}1502gitlab # [ 292.911940] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.561Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7da6477a1b8e3078b9814b9c","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7da6477a1b8e3078b9814b9c: done: 0.014337 sec","job_status":"done","queue_duration_s":0.975108,"scheduling_latency_s":0.975124,"redis_calls":13,"redis_duration_s":0.0013930000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000878,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014337,"completed_at":"2026-09-06T15:25:07.561Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503gitlab # [ 292.950792] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.562Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4753c067f3b805ba46cf115","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4753c067f3b805ba46cf115: start","job_status":"start","queue_duration_s":0.990537,"scheduling_latency_s":0.990553}1504gitlab # [ 292.962974] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.576Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4753c067f3b805ba46cf115","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4753c067f3b805ba46cf115: done: 0.014096 sec","job_status":"done","queue_duration_s":0.990537,"scheduling_latency_s":0.990553,"redis_calls":13,"redis_duration_s":0.001405,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014096,"completed_at":"2026-09-06T15:25:07.576Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505gitlab # [ 293.001687] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.577Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8b0d1146f373ec1fcf15f27","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8b0d1146f373ec1fcf15f27: start","job_status":"start","queue_duration_s":1.005719,"scheduling_latency_s":1.005735}1506gitlab # [ 293.013812] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.592Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8b0d1146f373ec1fcf15f27","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8b0d1146f373ec1fcf15f27: done: 0.014655 sec","job_status":"done","queue_duration_s":1.005719,"scheduling_latency_s":1.005735,"redis_calls":13,"redis_duration_s":0.0015040000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014655,"completed_at":"2026-09-06T15:25:07.592Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 293.053388] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.593Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d400a58d0e931862faf62e3","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d400a58d0e931862faf62e3: start","job_status":"start","queue_duration_s":1.021578,"scheduling_latency_s":1.021594}1508gitlab # [ 293.065424] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.608Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d400a58d0e931862faf62e3","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d400a58d0e931862faf62e3: done: 0.015114 sec","job_status":"done","queue_duration_s":1.021578,"scheduling_latency_s":1.021594,"redis_calls":13,"redis_duration_s":0.001567,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001039,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010485,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015114,"completed_at":"2026-09-06T15:25:07.608Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509gitlab # [ 293.104252] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.609Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e16d3f7721259f4865498e9","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e16d3f7721259f4865498e9: start","job_status":"start","queue_duration_s":1.037828,"scheduling_latency_s":1.037844}1510gitlab # [ 293.116370] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.624Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e16d3f7721259f4865498e9","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e16d3f7721259f4865498e9: done: 0.015028 sec","job_status":"done","queue_duration_s":1.037828,"scheduling_latency_s":1.037844,"redis_calls":13,"redis_duration_s":0.0016150000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001111,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010321,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015028,"completed_at":"2026-09-06T15:25:07.624Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511gitlab # [ 293.154840] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.625Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8de03d4ff992e4a0831e1ad0","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8de03d4ff992e4a0831e1ad0: start","job_status":"start","queue_duration_s":1.054026,"scheduling_latency_s":1.054043}1512gitlab # [ 293.167239] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.640Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8de03d4ff992e4a0831e1ad0","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8de03d4ff992e4a0831e1ad0: done: 0.014601 sec","job_status":"done","queue_duration_s":1.054026,"scheduling_latency_s":1.054043,"redis_calls":13,"redis_duration_s":0.001488,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000958,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010163,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014601,"completed_at":"2026-09-06T15:25:07.640Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513gitlab # [ 293.205933] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.641Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ed6e6afb080b18df01e3fc2","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ed6e6afb080b18df01e3fc2: start","job_status":"start","queue_duration_s":1.069771,"scheduling_latency_s":1.069787}1514gitlab # [ 293.218197] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.656Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ed6e6afb080b18df01e3fc2","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ed6e6afb080b18df01e3fc2: done: 0.015058 sec","job_status":"done","queue_duration_s":1.069771,"scheduling_latency_s":1.069787,"redis_calls":13,"redis_duration_s":0.0015300000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000994,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015058,"completed_at":"2026-09-06T15:25:07.656Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515gitlab # [ 293.257660] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c806cc64d871824f74ce55a2","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c806cc64d871824f74ce55a2: start","job_status":"start","queue_duration_s":1.085997,"scheduling_latency_s":1.086013}1516gitlab # [ 293.269903] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.672Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c806cc64d871824f74ce55a2","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c806cc64d871824f74ce55a2: done: 0.014277 sec","job_status":"done","queue_duration_s":1.085997,"scheduling_latency_s":1.086013,"redis_calls":13,"redis_duration_s":0.0014789999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000948,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014277,"completed_at":"2026-09-06T15:25:07.672Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517gitlab # [ 293.308439] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.673Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d3c5dcbd4a854458839b7a6","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d3c5dcbd4a854458839b7a6: start","job_status":"start","queue_duration_s":1.101382,"scheduling_latency_s":1.101399}1518gitlab # [ 293.320540] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d3c5dcbd4a854458839b7a6","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d3c5dcbd4a854458839b7a6: done: 0.014332 sec","job_status":"done","queue_duration_s":1.101382,"scheduling_latency_s":1.101399,"redis_calls":13,"redis_duration_s":0.001549,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009932,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014332,"completed_at":"2026-09-06T15:25:07.687Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519gitlab # [ 293.359239] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.688Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36836a4774cefa595d45598e","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36836a4774cefa595d45598e: start","job_status":"start","queue_duration_s":1.116814,"scheduling_latency_s":1.116829}1520gitlab # [ 293.371699] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.703Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36836a4774cefa595d45598e","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36836a4774cefa595d45598e: done: 0.014752 sec","job_status":"done","queue_duration_s":1.116814,"scheduling_latency_s":1.116829,"redis_calls":13,"redis_duration_s":0.0015570000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000573,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000984,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010207,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014752,"completed_at":"2026-09-06T15:25:07.703Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521gitlab # [ 293.411260] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.704Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98c13e5e156812c36e408161","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98c13e5e156812c36e408161: start","job_status":"start","queue_duration_s":1.132756,"scheduling_latency_s":1.132772}1522gitlab # [ 293.424576] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.719Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98c13e5e156812c36e408161","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98c13e5e156812c36e408161: done: 0.014714 sec","job_status":"done","queue_duration_s":1.132756,"scheduling_latency_s":1.132772,"redis_calls":13,"redis_duration_s":0.0015370000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001012,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014714,"completed_at":"2026-09-06T15:25:07.719Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523gitlab # [ 293.464989] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.720Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30da1ac97ad242d3b028838d","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30da1ac97ad242d3b028838d: start","job_status":"start","queue_duration_s":1.148533,"scheduling_latency_s":1.148548}1524gitlab # [ 293.477557] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.734Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30da1ac97ad242d3b028838d","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30da1ac97ad242d3b028838d: done: 0.014058 sec","job_status":"done","queue_duration_s":1.148533,"scheduling_latency_s":1.148548,"redis_calls":13,"redis_duration_s":0.001394,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000894,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009709,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014058,"completed_at":"2026-09-06T15:25:07.734Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525gitlab # [ 293.516963] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.735Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6e5cbb9320a6da8d3ae3ce8","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6e5cbb9320a6da8d3ae3ce8: start","job_status":"start","queue_duration_s":1.163662,"scheduling_latency_s":1.163678}1526gitlab # [ 293.529566] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.749Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6e5cbb9320a6da8d3ae3ce8","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6e5cbb9320a6da8d3ae3ce8: done: 0.014455 sec","job_status":"done","queue_duration_s":1.163662,"scheduling_latency_s":1.163678,"redis_calls":13,"redis_duration_s":0.001436,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009791,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014455,"completed_at":"2026-09-06T15:25:07.749Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527gitlab # [ 293.568972] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.751Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71ca6fa9c3913eb6bbc4e054","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71ca6fa9c3913eb6bbc4e054: start","job_status":"start","queue_duration_s":1.179263,"scheduling_latency_s":1.179279}1528gitlab # [ 293.581537] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71ca6fa9c3913eb6bbc4e054","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71ca6fa9c3913eb6bbc4e054: done: 0.01442 sec","job_status":"done","queue_duration_s":1.179263,"scheduling_latency_s":1.179279,"redis_calls":13,"redis_duration_s":0.0014759999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000941,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009975,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01442,"completed_at":"2026-09-06T15:25:07.765Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529gitlab # [ 293.620996] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.766Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cedf1d4b14302dfe42801d2f","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cedf1d4b14302dfe42801d2f: start","job_status":"start","queue_duration_s":1.194859,"scheduling_latency_s":1.194875}1530gitlab # [ 293.633630] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cedf1d4b14302dfe42801d2f","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cedf1d4b14302dfe42801d2f: done: 0.014434 sec","job_status":"done","queue_duration_s":1.194859,"scheduling_latency_s":1.194875,"redis_calls":13,"redis_duration_s":0.0014659999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000945,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010033,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014434,"completed_at":"2026-09-06T15:25:07.781Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531gitlab # [ 293.674116] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ae9f0bb2e4ae3d28aa87e31","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ae9f0bb2e4ae3d28aa87e31: start","job_status":"start","queue_duration_s":1.210429,"scheduling_latency_s":1.210445}1532gitlab # [ 293.686750] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ae9f0bb2e4ae3d28aa87e31","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ae9f0bb2e4ae3d28aa87e31: done: 0.015995 sec","job_status":"done","queue_duration_s":1.210429,"scheduling_latency_s":1.210445,"redis_calls":13,"redis_duration_s":0.002982,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002444,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015995,"completed_at":"2026-09-06T15:25:07.798Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533gitlab # [ 293.726345] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.799Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a9817efdb703ae67d1cd45b","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a9817efdb703ae67d1cd45b: start","job_status":"start","queue_duration_s":1.227565,"scheduling_latency_s":1.227581}1534gitlab # [ 293.738715] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.813Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a9817efdb703ae67d1cd45b","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a9817efdb703ae67d1cd45b: done: 0.014362 sec","job_status":"done","queue_duration_s":1.227565,"scheduling_latency_s":1.227581,"redis_calls":13,"redis_duration_s":0.001483,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009943,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014362,"completed_at":"2026-09-06T15:25:07.813Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535gitlab # [ 293.777290] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.814Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"699674f0f15213903bd848a5","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-699674f0f15213903bd848a5: start","job_status":"start","queue_duration_s":1.243089,"scheduling_latency_s":1.243105}1536gitlab # [ 293.789629] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"699674f0f15213903bd848a5","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-699674f0f15213903bd848a5: done: 0.014594 sec","job_status":"done","queue_duration_s":1.243089,"scheduling_latency_s":1.243105,"redis_calls":13,"redis_duration_s":0.001508,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000963,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010075,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014594,"completed_at":"2026-09-06T15:25:07.829Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537gitlab # [ 293.828744] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.830Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5196e6b67200c23a74cb21d0","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5196e6b67200c23a74cb21d0: start","job_status":"start","queue_duration_s":1.25891,"scheduling_latency_s":1.258927}1538gitlab # [ 293.841226] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.845Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5196e6b67200c23a74cb21d0","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5196e6b67200c23a74cb21d0: done: 0.014251 sec","job_status":"done","queue_duration_s":1.25891,"scheduling_latency_s":1.258927,"redis_calls":13,"redis_duration_s":0.001413,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014251,"completed_at":"2026-09-06T15:25:07.844Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539gitlab # [ 293.880736] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a75e39462fdf7e3af038da60","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a75e39462fdf7e3af038da60: start","job_status":"start","queue_duration_s":1.27438,"scheduling_latency_s":1.274396}1540gitlab # [ 293.893170] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.860Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a75e39462fdf7e3af038da60","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a75e39462fdf7e3af038da60: done: 0.014613 sec","job_status":"done","queue_duration_s":1.27438,"scheduling_latency_s":1.274396,"redis_calls":13,"redis_duration_s":0.00142,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009997,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014613,"completed_at":"2026-09-06T15:25:07.860Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541gitlab # [ 293.931862] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.862Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c03b9420a133a9f5abd19046","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c03b9420a133a9f5abd19046: start","job_status":"start","queue_duration_s":1.290132,"scheduling_latency_s":1.290148}1542gitlab # [ 293.944405] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c03b9420a133a9f5abd19046","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c03b9420a133a9f5abd19046: done: 0.015142 sec","job_status":"done","queue_duration_s":1.290132,"scheduling_latency_s":1.290148,"redis_calls":13,"redis_duration_s":0.001437,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000909,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009891,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015142,"completed_at":"2026-09-06T15:25:07.877Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543gitlab # [ 293.983116] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.878Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c6a520bc29766a4f1f738fe","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c6a520bc29766a4f1f738fe: start","job_status":"start","queue_duration_s":1.306392,"scheduling_latency_s":1.306407}1544gitlab # [ 293.995606] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.892Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c6a520bc29766a4f1f738fe","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c6a520bc29766a4f1f738fe: done: 0.014397 sec","job_status":"done","queue_duration_s":1.306392,"scheduling_latency_s":1.306407,"redis_calls":13,"redis_duration_s":0.001475,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014397,"completed_at":"2026-09-06T15:25:07.892Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545gitlab # [ 294.034348] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.893Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb180e9ec83638b4752bf9d0","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb180e9ec83638b4752bf9d0: start","job_status":"start","queue_duration_s":1.321969,"scheduling_latency_s":1.321986}1546gitlab # [ 294.046877] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.908Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb180e9ec83638b4752bf9d0","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb180e9ec83638b4752bf9d0: done: 0.014807 sec","job_status":"done","queue_duration_s":1.321969,"scheduling_latency_s":1.321986,"redis_calls":13,"redis_duration_s":0.00147,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010315,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014807,"completed_at":"2026-09-06T15:25:07.908Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547gitlab # [ 294.086777] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.909Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90cc1535bca86d9e666d8c4e","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90cc1535bca86d9e666d8c4e: start","job_status":"start","queue_duration_s":1.337996,"scheduling_latency_s":1.338013}1548gitlab # [ 294.099292] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.926Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90cc1535bca86d9e666d8c4e","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90cc1535bca86d9e666d8c4e: done: 0.016273 sec","job_status":"done","queue_duration_s":1.337996,"scheduling_latency_s":1.338013,"redis_calls":13,"redis_duration_s":0.001555,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000989,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011338,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016273,"completed_at":"2026-09-06T15:25:07.926Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549gitlab # [ 294.138319] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.927Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2d7648f05067e562fb92d0a","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2d7648f05067e562fb92d0a: start","job_status":"start","queue_duration_s":1.355473,"scheduling_latency_s":1.355491}1550gitlab # [ 294.151136] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.944Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2d7648f05067e562fb92d0a","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2d7648f05067e562fb92d0a: done: 0.017203 sec","job_status":"done","queue_duration_s":1.355473,"scheduling_latency_s":1.355491,"redis_calls":13,"redis_duration_s":0.001643,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000609,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001034,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017203,"completed_at":"2026-09-06T15:25:07.944Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 294.189775] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.945Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55faa28b409712361fd71b61","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55faa28b409712361fd71b61: start","job_status":"start","queue_duration_s":1.374008,"scheduling_latency_s":1.374026}1552gitlab # [ 294.202130] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.961Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55faa28b409712361fd71b61","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55faa28b409712361fd71b61: done: 0.015994 sec","job_status":"done","queue_duration_s":1.374008,"scheduling_latency_s":1.374026,"redis_calls":13,"redis_duration_s":0.001479,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010713,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015994,"completed_at":"2026-09-06T15:25:07.961Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1553gitlab # [ 294.240584] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ddee35c434e5ffa0c478eebf","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ddee35c434e5ffa0c478eebf: start","job_status":"start","queue_duration_s":1.391061,"scheduling_latency_s":1.391076}1554gitlab # [ 294.252873] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.976Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ddee35c434e5ffa0c478eebf","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ddee35c434e5ffa0c478eebf: done: 0.013976 sec","job_status":"done","queue_duration_s":1.391061,"scheduling_latency_s":1.391076,"redis_calls":13,"redis_duration_s":0.0013830000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000888,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009682,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013976,"completed_at":"2026-09-06T15:25:07.976Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555gitlab # [ 294.292541] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.978Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8fbe454857510d483a85b92","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8fbe454857510d483a85b92: start","job_status":"start","queue_duration_s":1.406226,"scheduling_latency_s":1.406243}1556gitlab # [ 294.304955] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.992Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8fbe454857510d483a85b92","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8fbe454857510d483a85b92: done: 0.013978 sec","job_status":"done","queue_duration_s":1.406226,"scheduling_latency_s":1.406243,"redis_calls":13,"redis_duration_s":0.0014,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000892,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009675,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013978,"completed_at":"2026-09-06T15:25:07.992Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1557gitlab # [ 294.343623] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:07.993Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d7e1a287c9e8fa633bf73bd","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d7e1a287c9e8fa633bf73bd: start","job_status":"start","queue_duration_s":1.42128,"scheduling_latency_s":1.421297}1558gitlab # [ 294.356172] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:08.007Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d7e1a287c9e8fa633bf73bd","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d7e1a287c9e8fa633bf73bd: done: 0.014173 sec","job_status":"done","queue_duration_s":1.42128,"scheduling_latency_s":1.421297,"redis_calls":13,"redis_duration_s":0.00145,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000924,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014173,"completed_at":"2026-09-06T15:25:08.007Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1559gitlab # [ 294.394649] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:08.008Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad91c1b00557707a8618805b","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad91c1b00557707a8618805b: start","job_status":"start","queue_duration_s":1.436532,"scheduling_latency_s":1.436547}1560gitlab # [ 294.407425] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:08.022Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad91c1b00557707a8618805b","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad91c1b00557707a8618805b: done: 0.014289 sec","job_status":"done","queue_duration_s":1.436532,"scheduling_latency_s":1.436547,"redis_calls":13,"redis_duration_s":0.001421,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000902,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009844,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014289,"completed_at":"2026-09-06T15:25:08.022Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1561gitlab # [ 294.447570] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:08.023Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1209c183d5de23932f6f307d","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1209c183d5de23932f6f307d: start","job_status":"start","queue_duration_s":1.451917,"scheduling_latency_s":1.451934}1562gitlab # [ 294.460160] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:08.037Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1209c183d5de23932f6f307d","created_at":"2026-09-06T15:25:06.434Z","trace_propagation_headers":{"sentry-trace":"c836737ce0584609b84e124c0a9838a6-b87a86b0969a4d8b","baggage":"sentry-trace_id=c836737ce0584609b84e124c0a9838a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9510c7d3d456016a3414b7dc53e76f05","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:25:06.571Z","job_size_bytes":2,"pid":2006,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1209c183d5de23932f6f307d: done: 0.014216 sec","job_status":"done","queue_duration_s":1.451917,"scheduling_latency_s":1.451934,"redis_calls":13,"redis_duration_s":0.001411,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009817,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014216,"completed_at":"2026-09-06T15:25:08.037Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1563gitlab # [ 305.757911] postgres[3229]: [3229] ERROR: relation "table_without_models" does not exist1564gitlab # [ 305.758518] postgres[3229]: [3229] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1565gitlab # [ 308.232450] redis[792]: 10 changes in 300 seconds. Saving...1566gitlab # [ 308.240916] redis[792]: Background saving started by pid 32601567gitlab # [ 308.245220] redis[3260]: BGSAVE done, 479 keys saved, 0 keys skipped, 122443 bytes written.1568gitlab # [ 308.252065] redis[3260]: DB saved on disk1569gitlab # [ 308.254395] redis[3260]: Fork CoW for RDB: current 1 MB, peak 1 MB, average 0 MB1570gitlab # [ 308.333506] redis[792]: Background saving terminated with success1571gitlab # [ 310.138509] postgres[861]: [861] LOG: checkpoint starting: time1572gitlab # [ 311.238593] gitaly[893]: time="2026-09-06T15:25:27.090Z" level=info msg="burden monitor stats" pid=8931573gitlab # [ 311.492755] runuser[2904]: pam_unix(runuser:session): session closed for user gitlab1574gitlab # [ 311.497179] setup-gitlab-start[2874]: + systemctl restart gitlab-sidekiq.service1575gitlab # [ 311.524098] systemd[1]: Stopping gitlab-sidekiq.service...1576gitlab # [ 311.527540] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:27.376Z","message":"Shutting down"}1577gitlab # [ 311.531936] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:27.377Z","message":"Scheduler exiting..."}1578gitlab # [ 311.536378] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:27.377Z","message":"Terminating quiet threads for default capsule"}1579gitlab # [ 311.541452] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:27.378Z","message":"Scheduler exiting..."}1580gitlab # [ 312.026272] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:27.879Z","message":"Pausing to allow jobs to finish..."}1581gitlab # [ 312.529721] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:28.381Z","message":"Bye!"}1582gitlab # [ 312.571527] sidekiq-cluster[2006]: {"severity":"INFO","time":"2026-09-06T15:25:28.424Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2006,"worker_id":"sidekiq_0","memwd_rss_bytes":920977408,"retry":0}1583gitlab # [ 316.105746] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1584gitlab # [ 316.106187] systemd[1]: Stopped gitlab-sidekiq.service.1585gitlab # [ 316.106380] systemd[1]: gitlab-sidekiq.service: Consumed 1min 47.368s CPU time over 3min 15.107s wall clock time, 937.1M memory peak, 4.5M read from disk.1586gitlab # [ 316.119811] systemd[1]: Started gitlab-sidekiq.service.1587gitlab # [ 316.124143] setup-gitlab-start[2874]: + mkdir -p /var/lib/secrets1588gitlab # [ 316.128794] setup-gitlab-start[2874]: + echo nixbot-test-token-of-20-chars1589gitlab # [ 316.131614] setup-gitlab-start[2874]: + chmod 644 /var/lib/secrets/gitlab-token1590gitlab # [ 316.134812] setup-gitlab-start[2874]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1591gitlab # [ 318.490682] gitaly[893]: time="2026-09-06T15:25:34.342Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1VN68FK9THGC4754J1XBXPB error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T15:25:44.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:25:34.340" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1592gitlab # [ 318.521256] gitaly[893]: time="2026-09-06T15:25:34.344Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1VN68FK9THGC4754J1XBXPB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T15:25:44.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:25:34.340" grpc.time_ms=1.672 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1593gitlab # [ 319.784557] gitaly[893]: time="2026-09-06T15:25:35.636Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1VN68FK9THGC4754J1XBXPB error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T15:25:45.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:25:35.635" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1594gitlab # [ 319.815281] gitaly[893]: time="2026-09-06T15:25:35.636Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1VN68FK9THGC4754J1XBXPB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T15:25:45.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:25:35.635" grpc.time_ms=0.632 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1595gitlab # [ 319.921742] gitaly[893]: time="2026-09-06T15:25:35.774Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1VN68FK9THGC4754J1XBXPB diskcache=1c916c9d-b2e1-4f6e-ac66-67f6da141321 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-06T15:25:45.071" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:25:35.702" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1596gitlab # [ 319.948386] gitaly[893]: time="2026-09-06T15:25:35.775Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=40 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1437 command.oublock=32 command.real_time_ms=47 command.spawn_token_fork_ms=6 command.system_time_ms=34 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN68FK9THGC4754J1XBXPB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-06T15:25:45.071" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:25:35.702" grpc.time_ms=72.822 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1597gitlab # [ 319.973097] gitaly[893]: time="2026-09-06T15:25:35.800Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1VN68FK9THGC4754J1XBXPB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T15:25:45.169" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:25:35.799" pid=893 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1598gitlab # [ 319.989517] gitaly[893]: time="2026-09-06T15:25:35.801Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1VN68FK9THGC4754J1XBXPB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T15:25:45.169" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:25:35.799" grpc.time_ms=1.516 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1599gitlab # [ 320.005026] gitaly[893]: time="2026-09-06T15:25:35.828Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN68FK9THGC4754J1XBXPB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-06T15:25:45.179" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:25:35.810" grpc.time_ms=17.334 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1600gitlab # [ 320.092495] gitaly[893]: time="2026-09-06T15:25:35.945Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1VN68FK9THGC4754J1XBXPB error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T15:25:45.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:25:35.945" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1601gitlab # [ 320.118611] gitaly[893]: time="2026-09-06T15:25:35.945Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1VN68FK9THGC4754J1XBXPB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T15:25:45.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:25:35.945" grpc.time_ms=0.445 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1602gitlab # [ 320.143194] gitaly[893]: time="2026-09-06T15:25:35.996Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1VN68FK9THGC4754J1XBXPB diskcache=b70ef1ce-e69d-427e-ba08-be5f1c9e6683 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-06T15:25:45.011" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:25:35.952" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1603gitlab # [ 320.163266] gitaly[893]: time="2026-09-06T15:25:35.996Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1437 command.oublock=32 command.real_time_ms=22 command.spawn_token_fork_ms=3 command.system_time_ms=14 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN68FK9THGC4754J1XBXPB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-06T15:25:45.011" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:25:35.952" grpc.time_ms=44.037 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1604gitlab # [ 320.183709] gitaly[893]: time="2026-09-06T15:25:36.011Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1VN68FK9THGC4754J1XBXPB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T15:25:46.000" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:25:36.011" pid=893 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1605gitlab # [ 320.198546] gitaly[893]: time="2026-09-06T15:25:36.012Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1VN68FK9THGC4754J1XBXPB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T15:25:46.000" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:25:36.011" grpc.time_ms=0.852 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1606gitlab # [ 320.212861] gitaly[893]: time="2026-09-06T15:25:36.033Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=4 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN68FK9THGC4754J1XBXPB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-06T15:25:46.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:25:36.018" grpc.time_ms=14.627 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1607gitlab # [ 320.253969] gitaly[893]: time="2026-09-06T15:25:36.107Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1VN68FK9THGC4754J1XBXPB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T15:25:46.092" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:25:36.103" grpc.time_ms=2.668 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1608gitlab # [ 320.271404] gitaly[893]: time="2026-09-06T15:25:36.121Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1VN68FK9THGC4754J1XBXPB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-06T15:25:46.110" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:25:36.120" grpc.time_ms=0.573 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1609gitlab # [ 320.917311] gitaly[893]: time="2026-09-06T15:25:36.769Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN68FK9THGC4754J1XBXPB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-06T15:25:46.119" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:25:36.750" grpc.time_ms=18.741 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1610gitlab # [ 321.024592] sidekiq-cluster[3298]: {"severity":"INFO","time":"2026-09-06T15:25:36.837Z","message":"Starting cluster with 1 processes"}1611gitlab # [ 321.387864] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:37 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 52211612gitlab # [ 321.392972] setup-gitlab-start[2874]: + mkdir -p /tmp/test-flake1613gitlab # [ 321.397882] setup-gitlab-start[2874]: + cd /tmp/test-flake1614gitlab # [ 321.399053] setup-gitlab-start[2874]: + git init -b master1615gitlab # [ 321.427147] setup-gitlab-start[3362]: Initialized empty Git repository in /tmp/test-flake/.git/1616gitlab # [ 321.429674] setup-gitlab-start[2874]: + git config user.name test1617gitlab # [ 321.434608] setup-gitlab-start[2874]: + git config user.email test@example.com1618gitlab # [ 321.441623] setup-gitlab-start[2874]: + cat1619gitlab # [ 321.447289] setup-gitlab-start[2874]: + git add flake.nix1620gitlab # [ 321.456932] setup-gitlab-start[2874]: + git commit -m 'initial commit'1621gitlab # [ 321.488818] setup-gitlab-start[3367]: [master (root-commit) 6c6fa01] initial commit1622gitlab # [ 321.491935] setup-gitlab-start[3367]: 1 file changed, 10 insertions(+)1623gitlab # [ 321.495473] setup-gitlab-start[3367]: create mode 100644 flake.nix1624gitlab # [ 321.498274] setup-gitlab-start[2874]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1625gitlab # [ 321.503126] setup-gitlab-start[2874]: + git push -u origin master1626gitlab # [ 321.634262] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:37 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 891627gitlab # [ 322.248913] gitaly[893]: time="2026-09-06T15:25:38.100Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1VN6DTGKK1MD6FDNESF1KBC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:25:38.080" grpc.time_ms=19.786 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1628gitlab # [ 322.290374] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:38 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 6121629gitlab # [ 322.682423] gitaly[893]: time="2026-09-06T15:25:38.535Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6EE4FMRCSZDKWJSFK9M6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-06T15:25:48.006" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:25:38.516" grpc.time_ms=18.165 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1630gitlab # [ 322.747748] gitaly[893]: time="2026-09-06T15:25:38.600Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VN6EE4FMRCSZDKWJSFK9M6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-06T15:26:08.085" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-06T15:25:38.586" grpc.time_ms=14.112 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1631gitlab # [ 322.843646] gitaly[893]: time="2026-09-06T15:25:38.696Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1VN6EE4FMRCSZDKWJSFK9M6 duration_ms=382ns method=POST pid=893 status=200 url="http://unix/api/v4/internal/allowed"1632gitlab # [ 322.890853] gitaly[893]: time="2026-09-06T15:25:38.743Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1VN6EE4FMRCSZDKWJSFK9M6 duration_ms=46ns method=POST pid=893 status=200 url="http://unix/api/v4/internal/pre_receive"1633gitlab # [ 322.899750] gitaly[893]: time="2026-09-06T15:25:38.744Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VN6EE4FMRCSZDKWJSFK9M6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5313 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:25:38.311" grpc.time_ms=432.789 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1634gitlab # [ 322.948699] gitaly[893]: time="2026-09-06T15:25:38.801Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VN6EE4FMRCSZDKWJSFK9M6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:25:38.799" grpc.time_ms=1.561 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1635gitlab # [ 323.023569] gitaly[893]: time="2026-09-06T15:25:38.876Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VN6EE4FMRCSZDKWJSFK9M6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:25:38.875" grpc.time_ms=1.1 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1636gitlab # [ 323.109440] gitaly[893]: time="2026-09-06T15:25:38.962Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VN6EE4FMRCSZDKWJSFK9M6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:25:38.961" grpc.time_ms=0.81 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1637gitlab # [ 323.344888] gitaly[893]: time="2026-09-06T15:25:39.196Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6EE4FMRCSZDKWJSFK9M6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-06T15:25:49.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:25:39.178" grpc.time_ms=18.014 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1638gitlab # [ 323.429562] gitaly[893]: time="2026-09-06T15:25:39.282Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1434 command.oublock=0 command.real_time_ms=33 command.spawn_token_fork_ms=4 command.system_time_ms=27 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6EE4FMRCSZDKWJSFK9M6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-06T15:25:49.072" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:25:39.242" grpc.time_ms=39.223 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1639gitlab # [ 323.493569] gitaly[893]: time="2026-09-06T15:25:39.346Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1VN6EE4FMRCSZDKWJSFK9M6 duration_ms=312ns method=POST pid=893 status=200 url="http://unix/api/v4/internal/post_receive"1640gitlab # [ 323.507376] gitaly[893]: time="2026-09-06T15:25:39.347Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VN6EE4FMRCSZDKWJSFK9M6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4807 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:25:39.033" grpc.time_ms=314.198 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1641gitlab # [ 323.541155] gitaly[893]: time="2026-09-06T15:25:39.394Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1VN6EE4FMRCSZDKWJSFK9M6 diskcache=604fb38c-1f79-4ce3-9672-e70198f6b13c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:25:38.201" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1642gitlab # [ 323.571952] gitaly[893]: time="2026-09-06T15:25:39.394Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=396 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13741 command.oublock=32 command.real_time_ms=1182 command.spawn_token_fork_ms=2 command.system_time_ms=209 command.user_time_ms=187 component=gitaly.StreamServerInterceptor correlation_id=01M1VN6EE4FMRCSZDKWJSFK9M6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:25:38.201" grpc.time_ms=1192.633 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1643gitlab # [ 323.603791] gitlab-workhorse[820]: time="2026-09-06T15:25:39Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521644gitlab # [ 323.607426] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:39 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 12781645gitlab # [ 323.611150] setup-gitlab-start[3371]: To http://gitlab/root/test-flake.git1646gitlab # [ 323.612770] setup-gitlab-start[3371]: * [new branch] master -> master1647gitlab # [ 323.614258] setup-gitlab-start[3371]: branch 'master' set up to track 'origin/master'.1648gitlab # [ 323.616341] systemd[1]: Finished setup-gitlab.service.1649gitlab # [ 323.617598] systemd[1]: Starting nixbot CI service...1650gitlab: (finished: waiting for unit setup-gitlab.service, in 324.89 seconds)1651gitlab: waiting for unit nixbot.service1652gitlab # [ 325.019141] nixbot[3461]: {"ts": "2026-09-06T15:25:40.870Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1653gitlab # [ 325.057049] nixbot[3461]: {"ts": "2026-09-06T15:25:40.909Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1654gitlab # [ 325.077822] nixbot[3461]: {"ts": "2026-09-06T15:25:40.930Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1655gitlab # [ 325.084586] nixbot[3461]: {"ts": "2026-09-06T15:25:40.936Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1656gitlab # [ 325.091140] nixbot[3461]: {"ts": "2026-09-06T15:25:40.941Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1657gitlab # [ 325.097525] nixbot[3461]: {"ts": "2026-09-06T15:25:40.947Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1658gitlab # [ 325.104515] nixbot[3461]: {"ts": "2026-09-06T15:25:40.952Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1659gitlab # [ 325.112292] nixbot[3461]: {"ts": "2026-09-06T15:25:40.954Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1660gitlab # [ 325.119438] nixbot[3461]: {"ts": "2026-09-06T15:25:40.961Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1661gitlab # [ 325.126191] nixbot[3461]: {"ts": "2026-09-06T15:25:40.963Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1662gitlab # [ 325.133037] nixbot[3461]: {"ts": "2026-09-06T15:25:40.968Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1663gitlab # [ 325.139612] nixbot[3461]: {"ts": "2026-09-06T15:25:40.975Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1664gitlab # [ 325.146386] nixbot[3461]: {"ts": "2026-09-06T15:25:40.979Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1665gitlab # [ 325.152852] nixbot[3461]: {"ts": "2026-09-06T15:25:40.981Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1666gitlab # [ 325.159264] nixbot[3461]: {"ts": "2026-09-06T15:25:40.985Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1667gitlab # [ 325.165474] nixbot[3461]: {"ts": "2026-09-06T15:25:40.987Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1668gitlab # [ 325.171069] nixbot[3461]: {"ts": "2026-09-06T15:25:40.989Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1669gitlab # [ 325.176595] nixbot[3461]: {"ts": "2026-09-06T15:25:40.990Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1670gitlab # [ 325.181515] nixbot[3461]: {"ts": "2026-09-06T15:25:40.994Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1671gitlab # [ 325.186450] nixbot[3461]: {"ts": "2026-09-06T15:25:40.996Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1672gitlab # [ 325.191517] nixbot[3461]: {"ts": "2026-09-06T15:25:40.998Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1673gitlab # [ 325.196229] nixbot[3461]: {"ts": "2026-09-06T15:25:41.003Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1674gitlab # [ 325.200560] nixbot[3461]: {"ts": "2026-09-06T15:25:41.005Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1675gitlab # [ 325.206171] nixbot[3461]: {"ts": "2026-09-06T15:25:41.007Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1676gitlab # [ 325.211669] nixbot[3461]: {"ts": "2026-09-06T15:25:41.008Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1677gitlab # [ 325.220206] nixbot[3461]: {"ts": "2026-09-06T15:25:41.010Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1678gitlab # [ 325.223973] nixbot[3461]: {"ts": "2026-09-06T15:25:41.012Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1679gitlab # [ 325.227680] nixbot[3461]: {"ts": "2026-09-06T15:25:41.013Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1680gitlab # [ 325.231445] nixbot[3461]: {"ts": "2026-09-06T15:25:41.014Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1681gitlab # [ 325.235282] nixbot[3461]: {"ts": "2026-09-06T15:25:41.025Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1682gitlab # [ 325.238570] nixbot[3461]: {"ts": "2026-09-06T15:25:41.029Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1683gitlab # [ 325.241628] nixbot[3461]: {"ts": "2026-09-06T15:25:41.031Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1684gitlab # [ 325.244687] nixbot[3461]: {"ts": "2026-09-06T15:25:41.033Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1685gitlab # [ 325.544204] nixbot[3461]: INFO: Started server process [3461]1686gitlab # [ 325.545764] nixbot[3461]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1687gitlab # [ 325.571535] nixbot[3461]: INFO: ::ffff:127.0.0.1:42826 - "GET /health HTTP/1.1" 200 OK1688gitlab # [ 325.580213] systemd[1]: Started nixbot CI service.1689gitlab # [ 325.583464] systemd[1]: Reached target Multi-User System.1690gitlab # [ 325.586114] systemd[1]: Startup finished in 773ms (kernel) + 3.642s (initrd) + 5min 21.170s (userspace) = 5min 25.585s.1691gitlab # [ 326.061963] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:41 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 4891692gitlab # [ 326.070072] nixbot[3461]: {"ts": "2026-09-06T15:25:41.916Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1693gitlab # [ 326.097094] nixbot[3461]: {"ts": "2026-09-06T15:25:41.949Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1694gitlab # [ 326.201922] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:42 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 901695gitlab # [ 326.204861] nixbot[3461]: {"ts": "2026-09-06T15:25:42.057Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1696gitlab # [ 326.207860] nixbot[3461]: {"ts": "2026-09-06T15:25:42.060Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1697gitlab: (finished: waiting for unit nixbot.service, in 2.15 seconds)1698gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1699gitlab # [ 326.618971] nixbot[3461]: INFO: ::ffff:127.0.0.1:42842 - "GET /health HTTP/1.1" 200 OK1700gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.03 seconds)1701subtest: project discovered and webhook registered1702gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1703gitlab # [ 326.628346] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:42 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 918 "" "python-httpx/0.28.1" 4151704gitlab # [ 326.632421] nixbot[3461]: {"ts": "2026-09-06T15:25:42.485Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1705gitlab # [ 326.820849] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:42 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "curl/8.21.0" 1561706gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.20 seconds)1707(finished: subtest: project discovered and webhook registered, in 0.20 seconds)1708subtest: push delivers the webhook1709gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1710gitlab # [ 326.981270] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:42 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 591711gitlab # [ 327.146896] gitaly[893]: time="2026-09-06T15:25:42.999Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=5 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VN6K1RCBSHMD62Z8JZ5Q0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:25:42.986" grpc.time_ms=12.443 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1712gitlab # [ 327.170397] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:43 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 1611713gitlab # Enumerating objects: 5, done.1714gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1715gitlab # Delta compression using up to 4 threads1716gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1717gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 137.00 KiB/s, done.1718gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1719gitlab # [ 327.687824] gitaly[893]: time="2026-09-06T15:25:43.540Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VN6K88P14JS4AV2T489RHS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-06T15:26:13.027" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-06T15:25:43.527" grpc.time_ms=13.336 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1720gitlab # [ 327.728692] gitaly[893]: time="2026-09-06T15:25:43.581Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1VN6K88P14JS4AV2T489RHS duration_ms=353ns method=POST pid=893 status=200 url="http://unix/api/v4/internal/allowed"1721gitlab # [ 327.769126] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:43 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 11161722gitlab # [ 327.779880] nixbot[3461]: {"ts": "2026-09-06T15:25:43.630Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1723gitlab # [ 327.789214] gitaly[893]: time="2026-09-06T15:25:43.636Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1VN6K88P14JS4AV2T489RHS duration_ms=54ns method=POST pid=893 status=200 url="http://unix/api/v4/internal/pre_receive"1724gitlab # [ 327.798628] gitaly[893]: time="2026-09-06T15:25:43.636Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VN6K88P14JS4AV2T489RHS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5313 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:25:43.226" grpc.time_ms=409.966 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1725gitlab # [ 327.824602] gitaly[893]: time="2026-09-06T15:25:43.671Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VN6K88P14JS4AV2T489RHS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:25:43.670" grpc.time_ms=0.605 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1726gitlab # [ 327.870436] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:43 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "python-httpx/0.28.1" 811727gitlab # [ 327.874679] nixbot[3461]: {"ts": "2026-09-06T15:25:43.724Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1728gitlab # [ 327.880362] gitaly[893]: time="2026-09-06T15:25:43.729Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VN6K88P14JS4AV2T489RHS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:25:43.728" grpc.time_ms=0.744 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1729gitlab # [ 327.916398] gitaly[893]: time="2026-09-06T15:25:43.769Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VN6K88P14JS4AV2T489RHS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:25:43.764" grpc.time_ms=4.437 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1730gitlab # [ 327.984005] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:43 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 918 "" "python-httpx/0.28.1" 1051731gitlab # [ 327.987661] nixbot[3461]: {"ts": "2026-09-06T15:25:43.835Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1732gitlab # [ 328.001511] gitaly[893]: time="2026-09-06T15:25:43.854Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1VN6K88P14JS4AV2T489RHS duration_ms=51ns method=POST pid=893 status=200 url="http://unix/api/v4/internal/post_receive"1733gitlab # [ 328.007573] gitaly[893]: time="2026-09-06T15:25:43.854Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VN6K88P14JS4AV2T489RHS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4807 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:25:43.801" grpc.time_ms=53.087 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1734gitlab # [ 328.022149] gitaly[893]: time="2026-09-06T15:25:43.875Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1VN6K88P14JS4AV2T489RHS diskcache=3d4f7781-987a-499b-89ae-0f159c9f47da grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:25:43.137" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1735gitlab # To http://gitlab/root/test-flake.git1736gitlab # [ 328.032428] gitaly[893]: time="2026-09-06T15:25:43.881Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=205 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=827392 command.minflt=13326 command.oublock=32 command.real_time_ms=726 command.spawn_token_fork_ms=2 command.system_time_ms=114 command.user_time_ms=91 component=gitaly.StreamServerInterceptor correlation_id=01M1VN6K88P14JS4AV2T489RHS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:25:43.137" grpc.time_ms=737.601 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1737gitlab # 6c6fa01..463fb3c [ 328.046920] gitlab-workhorse[820]: time="2026-09-06T15:25:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521738gitlab # master -> master[ 328.049340] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:43 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 8271739gitlab # 1740gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.24 seconds)1741gitlab: must succeed: git -C /tmp/test-flake rev-parse master1742gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.02 seconds)1743gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=463fb3c55b36c8dbb3035cc9cf272702a47b1444'1744gitlab # [ 328.080391] gitaly[893]: time="2026-09-06T15:25:43.933Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6M17NQMZMHCMY33TTPRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-06T15:26:13.416" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=255 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:25:43.917" grpc.time_ms=15.54 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1745gitlab # [ 328.099853] gitaly[893]: time="2026-09-06T15:25:43.952Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6M17NQMZMHCMY33TTPRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:26:13.451" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:25:43.952" grpc.time_ms=0.68 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1746gitlab # [ 328.120289] gitaly[893]: time="2026-09-06T15:25:43.970Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6M17NQMZMHCMY33TTPRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-06T15:25:53.016" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:25:43.956" grpc.time_ms=13.413 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1747gitlab # [ 328.144998] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:43 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 772 "" "python-httpx/0.28.1" 1501748gitlab # [ 328.183459] nixbot[3461]: {"ts": "2026-09-06T15:25:44.036Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1749gitlab # [ 328.194339] nixbot[3461]: INFO: ::ffff:127.0.0.1:42850 - "GET /api/repos/gitlab/root/test-flake/builds?commit=463fb3c55b36c8dbb3035cc9cf272702a47b1444 HTTP/1.1" 200 OK1750gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=463fb3c55b36c8dbb3035cc9cf272702a47b1444', in 0.11 seconds)1751gitlab # [ 328.306678] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:44 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1191752gitlab # [ 328.309803] nixbot[3461]: {"ts": "2026-09-06T15:25:44.161Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1753gitlab # [ 328.315551] nixbot[3461]: {"ts": "2026-09-06T15:25:44.168Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1754gitlab # [ 328.470156] gitaly[893]: time="2026-09-06T15:25:44.322Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M1VN6MD933JZVJB0WFS9HVXJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:25:44.304" grpc.time_ms=17.106 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1755gitlab # [ 328.507954] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:44 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 891756gitlab # [ 328.599264] gitaly[893]: time="2026-09-06T15:25:44.452Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6MG4AZMXY0AEGDF3CMZK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:25:44.434" pid=893 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1757gitlab # [ 328.632494] gitaly[893]: time="2026-09-06T15:25:44.452Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6MG4AZMXY0AEGDF3CMZK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:25:44.434" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1758gitlab # [ 328.662826] gitlab-workhorse[820]: time="2026-09-06T15:25:44Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131759gitlab # [ 328.666223] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:44 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1291760gitlab # [ 328.669490] gitaly[893]: time="2026-09-06T15:25:44.452Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6MG4AZMXY0AEGDF3CMZK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:25:44.434" grpc.time_ms=18.042 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1761gitlab # [ 328.718045] gitaly[893]: time="2026-09-06T15:25:44.571Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6MM9KGYNKE2G9KG421PQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:25:44.527" pid=893 remote_ip="2001:db8:1::1" request_sha=76ac1d1c7eaaaec68611b4a30b2789c8b562d5e3 response_bytes=418 span.kind=server system=grpc1762gitlab # [ 328.736527] gitaly[893]: time="2026-09-06T15:25:44.571Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1134 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=2 command.system_time_ms=19 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6MM9KGYNKE2G9KG421PQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:25:44.527" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1763gitlab # [ 328.758365] gitlab-workhorse[820]: time="2026-09-06T15:25:44Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=4181764gitlab # [ 328.761189] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:44 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 418 "" "git/2.55.0" 1141765gitlab # [ 328.763870] gitaly[893]: time="2026-09-06T15:25:44.571Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1134 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=2 command.system_time_ms=19 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6MM9KGYNKE2G9KG421PQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:25:44.527" grpc.time_ms=44.258 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1766gitlab # [ 328.855968] gitaly[893]: time="2026-09-06T15:25:44.708Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VN6MSF1DVKVVP7FSKBRH3M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:25:44.690" grpc.time_ms=17.683 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1767gitlab # [ 328.885722] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:44 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 861768gitlab # [ 328.975805] gitaly[893]: time="2026-09-06T15:25:44.828Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6MWEW6ZF6X6C890K0EE9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:25:44.810" pid=893 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1769gitlab # [ 328.989462] gitaly[893]: time="2026-09-06T15:25:44.829Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6MWEW6ZF6X6C890K0EE9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:25:44.810" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1770gitlab # [ 329.005759] gitlab-workhorse[820]: time="2026-09-06T15:25:44Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671771gitlab # [ 329.007817] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:44 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1111772gitlab # [ 329.010101] gitaly[893]: time="2026-09-06T15:25:44.832Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6MWEW6ZF6X6C890K0EE9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:25:44.810" grpc.time_ms=18.618 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1773gitlab # [ 329.150390] gitaly[893]: time="2026-09-06T15:25:45.003Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1VN6N2NY3JNP53JXY4F76F5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:25:44.985" grpc.time_ms=17.42 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1774gitlab # [ 329.173243] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:45 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 861775gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=463fb3c55b36c8dbb3035cc9cf272702a47b1444'1776gitlab # [ 329.256660] nixbot[3461]: INFO: ::ffff:127.0.0.1:42862 - "GET /api/repos/gitlab/root/test-flake/builds?commit=463fb3c55b36c8dbb3035cc9cf272702a47b1444 HTTP/1.1" 200 OK1777gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=463fb3c55b36c8dbb3035cc9cf272702a47b1444', in 0.06 seconds)1778gitlab # [ 329.323066] gitaly[893]: time="2026-09-06T15:25:45.176Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6N5FDRYNNJ20SDH1SYKM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:25:45.143" pid=893 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc1779gitlab # [ 329.354589] gitaly[893]: time="2026-09-06T15:25:45.176Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=2 command.system_time_ms=24 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6N5FDRYNNJ20SDH1SYKM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:25:45.143" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1780gitlab # [ 329.384615] gitlab-workhorse[820]: time="2026-09-06T15:25:45Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2161781gitlab # [ 329.387797] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:45 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 1691782gitlab # [ 329.391138] gitaly[893]: time="2026-09-06T15:25:45.176Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=2 command.system_time_ms=24 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6N5FDRYNNJ20SDH1SYKM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:25:45.143" grpc.time_ms=33.494 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1783gitlab # [ 329.530477] gitaly[893]: time="2026-09-06T15:25:45.382Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6NDFD9113SR7V9Y94GBR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:26:15.080" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:25:45.381" grpc.time_ms=1.394 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1784gitlab # [ 329.633765] gitaly[893]: time="2026-09-06T15:25:45.486Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=590 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1VN6NDFD9113SR7V9Y94GBR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-06T15:26:15.165" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:25:45.466" grpc.time_ms=20.285 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1785gitlab # [ 329.717383] gitaly[893]: time="2026-09-06T15:25:45.570Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=16 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VN6NDFD9113SR7V9Y94GBR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T15:25:55.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:25:45.547" grpc.time_ms=21.948 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1786gitlab # [ 329.785434] gitaly[893]: time="2026-09-06T15:25:45.638Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=3 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1VN6NDFD9113SR7V9Y94GBR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T15:25:55.074" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:25:45.615" grpc.time_ms=22.412 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1787gitlab # [ 329.970875] gitaly[893]: time="2026-09-06T15:25:45.823Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6NDFD9113SR7V9Y94GBR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-06T15:25:55.280" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:25:45.821" grpc.time_ms=0.874 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1788gitlab # [ 330.057246] gitaly[893]: time="2026-09-06T15:25:45.910Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=7 command.system_time_ms=9 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6NDFD9113SR7V9Y94GBR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-06T15:25:55.005" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:25:45.886" grpc.time_ms=23.005 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1789gitlab # [ 330.164256] gitaly[893]: time="2026-09-06T15:25:46.013Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VN6NDFD9113SR7V9Y94GBR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:25:46.009" grpc.time_ms=3.431 pid=893 span.kind=server system=grpc1790gitlab # [ 330.233079] gitaly[893]: time="2026-09-06T15:25:46.085Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VN6NDFD9113SR7V9Y94GBR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:25:46.083" grpc.time_ms=2.068 pid=893 span.kind=server system=grpc1791gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=463fb3c55b36c8dbb3035cc9cf272702a47b1444'1792gitlab # [ 330.275823] gitaly[893]: time="2026-09-06T15:25:46.128Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6NDFD9113SR7V9Y94GBR diskcache=bf32dbd4-6246-463c-9b22-adc01cb70165 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-06T15:25:55.037" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:25:45.918" pid=893 ref=refs/keep-around/463fb3c55b36c8dbb3035cc9cf272702a47b1444 remote_ip="2001:db8:1::1" revision=463fb3c55b36c8dbb3035cc9cf272702a47b1444 span.kind=server system=grpc username=root1793gitlab # [ 330.310314] gitaly[893]: time="2026-09-06T15:25:46.141Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=166 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5141 command.oublock=8 command.real_time_ms=197 command.spawn_token_fork_ms=3 command.system_time_ms=87 command.user_time_ms=79 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6NDFD9113SR7V9Y94GBR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-06T15:25:55.037" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:25:45.918" grpc.time_ms=222.562 pid=893 ref=refs/keep-around/463fb3c55b36c8dbb3035cc9cf272702a47b1444 remote_ip="2001:db8:1::1" revision=463fb3c55b36c8dbb3035cc9cf272702a47b1444 span.kind=server system=grpc username=root1794gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=463fb3c55b36c8dbb3035cc9cf272702a47b1444', in 0.09 seconds)1795gitlab # [ 330.337846] gitaly[893]: time="2026-09-06T15:25:46.163Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6NDFD9113SR7V9Y94GBR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:26:16.061" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:25:46.162" grpc.time_ms=0.682 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1796(finished: subtest: push delivers the webhook, in 3.53 seconds)1797subtest: eval and build post commit statuses1798gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses1799gitlab # [ 330.356461] nixbot[3461]: INFO: ::ffff:127.0.0.1:42876 - "GET /api/repos/gitlab/root/test-flake/builds?commit=463fb3c55b36c8dbb3035cc9cf272702a47b1444 HTTP/1.1" 200 OK1800gitlab # [ 330.463408] gitaly[893]: time="2026-09-06T15:25:46.316Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6PBWXP00JAKE259WJVY1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:26:16.014" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:25:46.315" grpc.time_ms=0.823 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1801gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses, in 0.20 seconds)1802gitlab # [ 330.552163] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:46 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses HTTP/1.1" 200 2 "" "curl/8.21.0" 1671803gitlab # [ 330.588264] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:46 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/463fb3c55b36c8dbb3035cc9cf272702a47b1444 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 11771804gitlab # [ 330.596807] nixbot[3461]: {"ts": "2026-09-06T15:25:46.442Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/463fb3c55b36c8dbb3035cc9cf272702a47b1444 \"HTTP/1.1 201 Created\""}1805gitlab # [ 330.605722] nixbot[3461]: {"ts": "2026-09-06T15:25:46.454Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-463fb3c55b36-0"}1806gitlab # [ 330.845971] nixbot[3461]: {"ts": "2026-09-06T15:25:46.698Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-463fb3c55b36-0", "argv0": "bwrap"}1807gitlab # [ 331.017918] systemd[1]: Started Nix Daemon.1808gitlab # [ 331.137153] nix-daemon[3692]: accepted connection from pid 3687, user nixbot1809gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses1810gitlab # [ 331.716595] gitaly[893]: time="2026-09-06T15:25:47.568Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6QJ563Y8WXC2J6MJVDKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:26:17.266" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:25:47.566" grpc.time_ms=1.211 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1811gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses, in 0.22 seconds)1812gitlab # [ 331.777851] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:47 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1681813gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses1814gitlab # [ 332.923710] gitaly[893]: time="2026-09-06T15:25:48.775Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6RRD6B2WJBADHKDAR7TC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:26:18.273" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:25:48.774" grpc.time_ms=1.137 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1815gitlab # [ 333.087566] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:48 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 2531816gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses, in 0.31 seconds)1817gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses1818gitlab # [ 334.236584] gitaly[893]: time="2026-09-06T15:25:50.085Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6T1BG7YG19E6TNBGMZXZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:26:20.083" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:25:50.083" grpc.time_ms=1.179 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1819gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses, in 0.21 seconds)1820gitlab # [ 334.298307] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:50 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1541821gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses1822gitlab # [ 335.453403] gitaly[893]: time="2026-09-06T15:25:51.305Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6V7459545NEW0K743R3P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:26:21.002" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:25:51.303" grpc.time_ms=1.324 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1823gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses, in 0.21 seconds)1824gitlab # [ 335.510505] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:51 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1571825gitlab # [ 335.834423] nix-daemon[3692]: accepted connection from pid 3731, user nixbot1826gitlab # [ 335.855136] nix-daemon[3692]: accepted connection from pid 3687, user nixbot1827gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses1828gitlab # [ 336.667757] gitaly[893]: time="2026-09-06T15:25:52.519Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6WD2NH5NH9GK6B2W7CW0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:26:22.017" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:25:52.518" grpc.time_ms=1.372 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1829gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses, in 0.22 seconds)1830gitlab # [ 336.725711] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:52 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1581831gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses1832gitlab # [ 337.889554] gitaly[893]: time="2026-09-06T15:25:53.741Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6XK6TM2NHPYECEJAR2DY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:26:23.439" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:25:53.739" grpc.time_ms=1.257 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1833gitlab # [ 337.936393] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:53 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1491834gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses, in 0.21 seconds)1835gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses1836gitlab # [ 339.097037] gitaly[893]: time="2026-09-06T15:25:54.948Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6YRYEK9Q4DXW45VJSFAR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:26:24.446" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:25:54.947" grpc.time_ms=1.22 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1837gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses, in 0.21 seconds)1838gitlab # [ 339.144298] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:54 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1491839gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses1840gitlab # [ 340.233444] nix-daemon[3692]: accepted connection from pid 3687, user nixbot1841gitlab # [ 340.317231] gitaly[893]: time="2026-09-06T15:25:56.167Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN6ZYP77AN175QDPAA4C6T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:26:26.166" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:25:56.166" grpc.time_ms=0.964 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1842gitlab # [ 340.359511] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:56 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1571843gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses, in 0.22 seconds)1844gitlab # [ 340.436460] gitaly[893]: time="2026-09-06T15:25:56.289Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN703C8AK96PQJETBWBRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:26:26.187" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:25:56.288" grpc.time_ms=0.886 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1845gitlab # [ 340.488793] gitaly[893]: time="2026-09-06T15:25:56.341Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VN703C8AK96PQJETBWBRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T15:26:06.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:25:56.330" grpc.time_ms=10.847 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1846gitlab # [ 340.568649] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/463fb3c55b36c8dbb3035cc9cf272702a47b1444 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 2171847gitlab # [ 340.573494] nixbot[3461]: {"ts": "2026-09-06T15:25:56.423Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/463fb3c55b36c8dbb3035cc9cf272702a47b1444 \"HTTP/1.1 201 Created\""}1848gitlab # [ 340.677359] gitaly[893]: time="2026-09-06T15:25:56.530Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN70ACR5KJPBTJ9C091KRM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:26:26.028" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:25:56.528" grpc.time_ms=1.171 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1849gitlab # [ 340.800658] gitaly[893]: time="2026-09-06T15:25:56.653Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M1VN70ACR5KJPBTJ9C091KRM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T15:26:06.125" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:25:56.636" grpc.time_ms=17.088 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1850gitlab # [ 340.914692] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/463fb3c55b36c8dbb3035cc9cf272702a47b1444 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 3381851gitlab # [ 340.922864] nixbot[3461]: {"ts": "2026-09-06T15:25:56.769Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/463fb3c55b36c8dbb3035cc9cf272702a47b1444 \"HTTP/1.1 201 Created\""}1852gitlab # [ 341.026519] gitaly[893]: time="2026-09-06T15:25:56.879Z" level=info msg="finished unary call with code OK" catfile.duration_ms=5 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=5 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN70NSY546KDZ5TH9YJT11 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:26:26.372" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:25:56.872" grpc.time_ms=6.445 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1853gitlab # [ 341.084410] gitaly[893]: time="2026-09-06T15:25:56.937Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=8 component=gitaly.StreamServerInterceptor correlation_id=01M1VN70NSY546KDZ5TH9YJT11 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T15:26:06.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:25:56.924" grpc.time_ms=12.491 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1854gitlab # [ 341.173140] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:57 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/463fb3c55b36c8dbb3035cc9cf272702a47b1444 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2321855gitlab # [ 341.178931] nixbot[3461]: {"ts": "2026-09-06T15:25:57.027Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/463fb3c55b36c8dbb3035cc9cf272702a47b1444 \"HTTP/1.1 201 Created\""}1856gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses1857gitlab # [ 341.499281] gitaly[893]: time="2026-09-06T15:25:57.351Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VN714C0F8SMGHY5XY4P746 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:26:27.050" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:25:57.350" grpc.time_ms=0.749 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1858gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses, in 0.19 seconds)1859gitlab # [ 341.543962] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/06:15:25:57 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/463fb3c55b36c8dbb3035cc9cf272702a47b1444/statuses HTTP/1.1" 200 1334 "" "curl/8.21.0" 1351860(finished: subtest: eval and build post commit statuses, in 11.19 seconds)1861(finished: run the VM test script, in 412.61 seconds)1862test script finished in 412.66s1863cleanup1864kill QemuMachine (pid 46)1865gitlab # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)1866(finished: cleanup, in 1.59 seconds)1867additionally exposed symbols:1868 gitlab,1869 vlan1,1870 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh1871[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-06T15:25:42.420Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]1872[]1873[]1874[{'id': 1, 'project_id': 1, 'number': 1, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '463fb3c55b36c8dbb3035cc9cf272702a47b1444', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-09-06T15:25:45.240757Z', 'started_at': None, 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': {'position': 1, 'blocked_by': []}}]1875[]1876[{'id': 1, 'sha': '463fb3c55b36c8dbb3035cc9cf272702a47b1444', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-06T15:25:46.393Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]1877[{'id': 1, 'sha': '463fb3c55b36c8dbb3035cc9cf272702a47b1444', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-06T15:25:46.393Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]1878[{'id': 1, 'sha': '463fb3c55b36c8dbb3035cc9cf272702a47b1444', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-06T15:25:46.393Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]1879[{'id': 1, 'sha': '463fb3c55b36c8dbb3035cc9cf272702a47b1444', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-06T15:25:46.393Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]1880[{'id': 1, 'sha': '463fb3c55b36c8dbb3035cc9cf272702a47b1444', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-06T15:25:46.393Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]1881[{'id': 1, 'sha': '463fb3c55b36c8dbb3035cc9cf272702a47b1444', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-06T15:25:46.393Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]1882[{'id': 1, 'sha': '463fb3c55b36c8dbb3035cc9cf272702a47b1444', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-06T15:25:46.393Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]1883[{'id': 1, 'sha': '463fb3c55b36c8dbb3035cc9cf272702a47b1444', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-06T15:25:46.393Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]1884[{'id': 1, 'sha': '463fb3c55b36c8dbb3035cc9cf272702a47b1444', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluation succeeded in 9s (1 warning)', 'created_at': '2026-09-06T15:25:46.393Z', 'started_at': None, 'finished_at': '2026-09-06T15:25:56.376Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 2, 'sha': '463fb3c55b36c8dbb3035cc9cf272702a47b1444', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': '0 attributes built', 'created_at': '2026-09-06T15:25:56.713Z', 'started_at': None, 'finished_at': '2026-09-06T15:25:56.982Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]